-- Logs begin at Tue 2022-07-12 06:32:17 UTC, end at Tue 2022-07-12 07:42:51 UTC. -- Jul 12 07:05:59.430464 dv-cinder-825492-25-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 07:05:59.441054 dv-cinder-825492-25-smb devstack@keystone.service[80326]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 07:05:59 2022] *** Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: nodename: dv-cinder-825492-25-smb Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: machine: x86_64 Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: clock source: unix Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: pcre jit disabled Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: detected number of CPU cores: 4 Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: current working directory: / Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: detected binary path: /usr/bin/uwsgi-core Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: your processes number limit is 47680 Jul 12 07:05:59.442989 dv-cinder-825492-25-smb devstack@keystone.service[80326]: your memory page size is 4096 bytes Jul 12 07:05:59.443693 dv-cinder-825492-25-smb devstack@keystone.service[80326]: detected max file descriptor number: 2048 Jul 12 07:05:59.443693 dv-cinder-825492-25-smb devstack@keystone.service[80326]: lock engine: pthread robust mutexes Jul 12 07:05:59.443693 dv-cinder-825492-25-smb devstack@keystone.service[80326]: thunder lock: enabled Jul 12 07:05:59.443693 dv-cinder-825492-25-smb devstack@keystone.service[80326]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 07:05:59.443693 dv-cinder-825492-25-smb devstack@keystone.service[80326]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 07:05:59.487353 dv-cinder-825492-25-smb devstack@keystone.service[80326]: Python main interpreter initialized at 0x55d3c72069c0 Jul 12 07:05:59.487353 dv-cinder-825492-25-smb devstack@keystone.service[80326]: python threads support enabled Jul 12 07:05:59.487353 dv-cinder-825492-25-smb devstack@keystone.service[80326]: your server socket listen backlog is limited to 100 connections Jul 12 07:05:59.487353 dv-cinder-825492-25-smb devstack@keystone.service[80326]: your mercy for graceful operations on workers is 90 seconds Jul 12 07:05:59.487694 dv-cinder-825492-25-smb devstack@keystone.service[80326]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 07:05:59.487764 dv-cinder-825492-25-smb devstack@keystone.service[80326]: *** Operational MODE: preforking *** Jul 12 07:05:59.488029 dv-cinder-825492-25-smb devstack@keystone.service[80326]: *** uWSGI is running in multiple interpreter mode *** Jul 12 07:05:59.488029 dv-cinder-825492-25-smb devstack@keystone.service[80326]: spawned uWSGI master process (pid: 80326) Jul 12 07:05:59.488227 dv-cinder-825492-25-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 07:05:59.492139 dv-cinder-825492-25-smb devstack@keystone.service[80326]: spawned uWSGI worker 1 (pid: 80336, cores: 1) Jul 12 07:05:59.492139 dv-cinder-825492-25-smb devstack@keystone.service[80326]: spawned uWSGI worker 2 (pid: 80337, cores: 1) Jul 12 07:05:59.492139 dv-cinder-825492-25-smb devstack@keystone.service[80326]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 07:06:04.954592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:06:04.954592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: from cryptography.utils import int_from_bytes Jul 12 07:06:04.955366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:06:04.955366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: from cryptography.utils import int_from_bytes Jul 12 07:06:04.955487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:06:04.955487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: from cryptography.utils import int_from_bytes Jul 12 07:06:04.955487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 07:06:04.955487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: from cryptography.utils import int_from_bytes Jul 12 07:06:05.004180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:06:05.004399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:06:05.004616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] command line args: [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:06:05.004719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 07:06:05.004908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 07:06:05.004995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:06:05.005110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ================================================================================ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:06:05.005185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] command line args: [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 07:06:05.005392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] admin_token = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.005479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 07:06:05.005557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ================================================================================ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 07:06:05.005670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_dir = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.005805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] admin_token = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.005885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_dir = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] config_source = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] debug = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] config_source = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] debug = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.006924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.007025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.007198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.007449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.007859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.007968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_config_append = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_dir = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_config_append = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.008955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_dir = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.009974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.010893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.011927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] publish_errors = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.012879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] publish_errors = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.013897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] standard_threads = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_journal = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.014980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] standard_threads = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.015080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_json = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.015183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.015298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_stderr = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.015931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] use_syslog = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_journal = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.016457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_json = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_stderr = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] use_syslog = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.016671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 07:06:05.016772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.017924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.018882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.019962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.020894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.021952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.022919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.023961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.024962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.025916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.026917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.027947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.028740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.028740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.028953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.029930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.030917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.031121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.031978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.032166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.032371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.032568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.032713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.032713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033393 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.033840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.034998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.035982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.036973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.037796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.038931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.039867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.040920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.external = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.041883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.password = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] auth.token = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.042929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.043952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.044936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.045947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.046834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.047917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.048895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.049949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.050953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.051937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.052909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.053893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.054898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.external = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.055880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.password = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] auth.token = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.056904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.057981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.058949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.059891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.060899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.061791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.062841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.063884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.064856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.065952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.066950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.067771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.068984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.069947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.070976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.071930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.072348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.072498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.072585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.072829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.072908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.073905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.074769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.075967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.076937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.077203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.077283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.077452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.077556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.077698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.078474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.078564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.078820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.078968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.079955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080406 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.080838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.081919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.082973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.083986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.084987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.085983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.086868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.087846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.088804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.089895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.090859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.091940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.092909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.093202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.093297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.093450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.094908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80336) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:06:05.095103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.095424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.095726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.096041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.096362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.096671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.096977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.097303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.097612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.097921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.098221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.098538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.098838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.099143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.099440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.099736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.100033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.100339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.100641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.100931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.101259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.101567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.101884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.102195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.102497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.102810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.103141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.103441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.103753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.104056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.104361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.104662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.104971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.105292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.105609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.105919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.106231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.106547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.106857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.107173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.107483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.107794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.108092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.108402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.108711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.109038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.109398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.109869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.110172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.110542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.110860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.111174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.111505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.111807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.112126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.112442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.112748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.113074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.113378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.113670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.113989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.114306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.114619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.114918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.115217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.115509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.115814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.116111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.116421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.116718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.117058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.117384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.117688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.117996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.118304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.118616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.118919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.119223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.119523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.119841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.120155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.120453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.120763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.121159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.121482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.121786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.122093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.122390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.122690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.122985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.123283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.123579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.123875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.124186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.124480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.124807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.125140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.125221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.125428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.125508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.125661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.125829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.126166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.126485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.126802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.127102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 07:06:05.127338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80337) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 07:06:05.134483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.153597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.153824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.154047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.163229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.163382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.163552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.181063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.181297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.306228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.307552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.355805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.356040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.356420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.356655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.421816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.422960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.423077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.463685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.463939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.464889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.465015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.465115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.465291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.476198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.476810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.488809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.489920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80337) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.490821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80336) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 07:06:05.507780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.507990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 07:06:05.508320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.508517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 07:06:05.508780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.508957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.509062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.509201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 07:06:05.509284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.509535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.509615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.509737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 07:06:05.510036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.510586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.510842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.511102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.521469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.521740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.522004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.522278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.523115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.523396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.523670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.523956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.530393 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.532726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.533795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.534074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.534348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.534730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.535012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.535267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.535529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.535795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.536326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.536876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.537187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.537452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.537725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.538002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.538273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.538545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.538812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.563852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.565443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.565716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.567100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.569015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.569319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.570966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.571242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.571517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.574884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.575163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.575562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.579330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.579607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.583447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.583751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.584221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.584504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.584777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.585077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.585353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.585619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.585883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.586144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.588263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.588550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.588832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.589141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.589420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.589696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.589965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.590230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.605443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.605714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.610311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.610568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.610847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.613957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.614246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.615454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.619133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.619291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.619429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.622925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.624626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.627228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.627539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.627826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.628114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.628390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.628670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.629545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.633238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.633539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.633841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.634129 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.634423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.634712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.648294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.648660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.648927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.649217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.655016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.655303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.655573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.655839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.657326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.659023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.659294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.662355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.662632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.662909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.663183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.663463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.664327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.666073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.666351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.669871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.670152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.670436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.670720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.670999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.677545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.677817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.678093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.678380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.678656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.678935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.679204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.685429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.685710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.685991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.686270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.686563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.689138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.689447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.699257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.702677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.706308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.707925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.708391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.709594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.709871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.710154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.711717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.715090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.716852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.717607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.718566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.719329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.719436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.719625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.722767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.723052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.723331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.723606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.727125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.728733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.732005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.732306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.732702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.732846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.732990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.733152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.733429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.741814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80337) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.742088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.742361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.742631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.742898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.743451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.743985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.744246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.744517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.744780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.745061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.745321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80337) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.752333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80336) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 07:06:05.752614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.752896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.753199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.753474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.753856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.754135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.754411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.754689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.754969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.755251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.755513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.755778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.756048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80336) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 07:06:05.783572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3c72069c0 pid: 80337 (default app) Jul 12 07:06:05.786918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4f98-ab4d-4a15-87ca-d508422f468e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:05.787218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4f98-ab4d-4a15-87ca-d508422f468e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:05.787501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd4f98-ab4d-4a15-87ca-d508422f468e None None] PATH_INFO: `/v3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:05.791694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Tue Jul 12 07:06:05 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:05.796570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d3c72069c0 pid: 80336 (default app) Jul 12 07:06:14.264223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:14.264746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:14.264746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:14.266383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:14.273909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:14.274343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:14.274465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:14.342272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: INFO dbcounter [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] Registered counter for database keystone Jul 12 07:06:14.364322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG oslo_db.sqlalchemy.engines [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80336) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:06:14.370409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writer thread running {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:06:14.545920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG passlib.handlers.bcrypt [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80336) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 07:06:14.546253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG passlib.handlers.bcrypt [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80336) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 07:06:14.601209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:14.606301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:14.724878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1/3] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 07:06:14.895866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:14.966277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: INFO dbcounter [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] Registered counter for database keystone Jul 12 07:06:14.986257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG oslo_db.sqlalchemy.engines [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80337) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 07:06:14.992393 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writer thread running {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 07:06:15.114014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e6084-494e-4a93-b5fe-82c7d68986b9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:15.118346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:15.119011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:15.119304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:15.119587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:15.128372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:15.181545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING keystone.common.rbac_enforcer.enforcer [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 07:06:15.181897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af322174-90ba-417c-aeec-d6e2b8fd9f28 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:15.191773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 3/4] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Jul 12 07:06:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 07:06:15.197991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:15.212944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaf468-1421-4577-ae7f-3b1fa86322c6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:15.217404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:15.219423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:15.219715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:15.219999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] PATH_INFO: `/v3/projects/283d7870f6d24d52afa389aaf0d60d70` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:15.224037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] RBAC: Authorizing `identity:get_project(project_id=283d7870f6d24d52afa389aaf0d60d70)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:15.275556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 07:06:15.276108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b3e2f-3cd9-4759-b912-1a1e8c80e28a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:15.280522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 2/5] 10.222.0.27 () {56 vars in 1207 bytes} [Tue Jul 12 07:06:15 2022] GET /identity/v3/projects/283d7870f6d24d52afa389aaf0d60d70 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:17.360842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134d0ee-d887-4fad-8248-3553f42fcff0 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:17.361354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134d0ee-d887-4fad-8248-3553f42fcff0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:17.361354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134d0ee-d887-4fad-8248-3553f42fcff0 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:17.365422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 4/6] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:17.370680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:17.371146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:17.371235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:17.396301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:17.397854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:17.406348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 3/7] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 07:06:17.429650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134d0ee-d887-4fad-8248-3553f42fcff0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:17.441585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134d0ee-d887-4fad-8248-3553f42fcff0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:17.445728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:17.446357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:17.446643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:17.446926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:17.454880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:17.456652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f76490-4d47-44a3-88c6-140458184a13 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:17.465349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 5/8] 10.222.0.27 () {58 vars in 1324 bytes} [Tue Jul 12 07:06:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 07:06:17.470983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:17.479822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86144dd-c253-4a36-86be-ecb352bdf87f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:17.484865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:17.485758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:17.486037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:17.486315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:17.487732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:17.489588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9255c7-4dff-4082-bc8e-72feca7b15b5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:17.491143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 4/9] 10.222.0.27 () {56 vars in 1198 bytes} [Tue Jul 12 07:06:17 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:19.546991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235411-a3ad-4f6c-8a1b-4ed51ca427c1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.547512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235411-a3ad-4f6c-8a1b-4ed51ca427c1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.547617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3235411-a3ad-4f6c-8a1b-4ed51ca427c1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.548988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:19.554217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.554649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.554788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.571646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:19.573128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:19.578990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43bf7-da37-446e-bf57-a5f5aec2d30c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.579282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43bf7-da37-446e-bf57-a5f5aec2d30c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.579562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a43bf7-da37-446e-bf57-a5f5aec2d30c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.580891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 7/11] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:19.586140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.586432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.586714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.626384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG passlib.handlers.bcrypt [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80337) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 07:06:19.626799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG passlib.handlers.bcrypt [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80337) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 07:06:19.654976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 5/12] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:19.672314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:19.673943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:19.677935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:19.702382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:19.774510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 8/13] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:19.783945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a231305-fda6-4b03-ab17-cc1a8a805fee None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:19.797541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:19.818653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:19.819456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.819748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.820028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.832072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:19.843375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:19.844243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:19.845218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 6/14] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:19.850305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:19.900711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70bc94-9446-4410-84d1-ab1eea185df5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:19.903025 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:19.932038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:19.938474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:19.939371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.939673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.939963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.952019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c557ec-75e3-4d7e-9509-c503d4b312ef None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:19.988267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:19.988940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:19.989266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:19.989546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:19.990302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:19.990608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:19.992016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.003662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 7/15] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:20.008002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.009035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:20.009568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.106822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 9/16] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 07:06:20.112297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:20.113464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbccdb1-bae4-41d8-a94c-bf2cbd129091 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:20.115002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:20.147877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:20.148776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:20.149083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:20.149361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:20.150557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.152046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.153694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 8/17] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:20 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:20.159274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:20.174245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:20.211974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567ad7d-8ee5-4c54-af7f-6d41d97bb88d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:20.247887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:20.248678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:20.249077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:20.249460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:20.256943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc0b5-5f46-4442-ba71-0be6debfb9c4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:20.269195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.270649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:20.290751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:20.291037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:20.291314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:06:20.291595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:20.292390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:20.293225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:06:20.293225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:06:20.293225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:06:20.293225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:20.293441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.293515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:20.293985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.295593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:20.299264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:20.302463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:20.355972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:20.384251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:20.399786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5b308-81ac-4023-9b34-18069c1832b5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:20.402939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2ee3b-876d-4083-94d8-ef582658e4f0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:20.435327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:20.435985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:20.436269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:20.436546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:20.438024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:20.438332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.439153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:20.439722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b0092-48aa-4a34-b376-9de5d3aa428f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.439810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:20.440074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:20.440377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:20.441238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.domain.id=default, user.id=ea7c343155f0487dbe56b20027ac902d) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:20.441554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:20.442959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5f36f6-e25d-46de-b5a3-d3ab81a9468c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:20.449894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 10/20] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Jul 12 07:06:20 2022] GET /identity/v3/role_assignments?user.id=ea7c343155f0487dbe56b20027ac902d&scope.domain.id=default&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:20.457943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 11/21] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:22.832135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc8d3-cbb9-471e-b9c0-a772e41edc54 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:22.832644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc8d3-cbb9-471e-b9c0-a772e41edc54 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:22.832716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcc8d3-cbb9-471e-b9c0-a772e41edc54 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:22.834228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 11/22] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:22.839262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:22.839652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:22.839816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:22.866114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:22.867337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:22.951615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:22.990543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcc8d3-cbb9-471e-b9c0-a772e41edc54 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.129772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcc8d3-cbb9-471e-b9c0-a772e41edc54 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.179082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:23.179883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.180176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.180452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.194955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-29bbb19c-e3be-4bc2-98f4-0ac5a2ce2fb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:23.203513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:23.204350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:23.205123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 12/24] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:23.211978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.268803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:23.331731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd65b-8153-4f2b-a7c0-42950678c306 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.379088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:23.379770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.380109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.380331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.381120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:23.381430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:23.382836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7041be-04ef-4c01-8a2c-2c7c98dc1d37 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:23.386568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b815-a199-4d3d-a78b-e31f20fd8de6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.387113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b815-a199-4d3d-a78b-e31f20fd8de6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.387609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4545b815-a199-4d3d-a78b-e31f20fd8de6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.389518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 13/25] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:23.395003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a67e4-eaa8-40ae-b739-8987367da2de None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.395551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a67e4-eaa8-40ae-b739-8987367da2de None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.396051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a67e4-eaa8-40ae-b739-8987367da2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.401875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 13/26] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:23.406952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dafbf-a86f-4ac4-8a47-25ad5c7d9794 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.408304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dafbf-a86f-4ac4-8a47-25ad5c7d9794 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.408785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074dafbf-a86f-4ac4-8a47-25ad5c7d9794 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.415741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 14/27] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:23.415860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:23.417823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dafbf-a86f-4ac4-8a47-25ad5c7d9794 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.425932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-673a67e4-eaa8-40ae-b739-8987367da2de None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:23.431822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-673a67e4-eaa8-40ae-b739-8987367da2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:23.526313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 14/28] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:23.528131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.528623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.529228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.547765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:23.549327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:23.564500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074dafbf-a86f-4ac4-8a47-25ad5c7d9794 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.583376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:23.612414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:23.613316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.613597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.613881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.615870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:23.617934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2a092-94cd-48d4-87e3-a12f7fef8f8f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:23.620589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 15/29] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:23 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:23.621767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e38-fd38-4753-84d0-b179a7dcb1e0 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.622157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e38-fd38-4753-84d0-b179a7dcb1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.622533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48e38-fd38-4753-84d0-b179a7dcb1e0 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.624872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:23.629434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48e38-fd38-4753-84d0-b179a7dcb1e0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.636760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 15/31] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:23.637736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.716981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:23.760047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce60c5c-f30a-4623-8ec2-4cf8b503c49a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.760662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48e38-fd38-4753-84d0-b179a7dcb1e0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.796147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:23.797366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:23.797672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.797957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.798163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.798277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.798434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.798699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.799547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:23.801007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb299b4-0eca-4a9c-aff8-2b628071c749 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:23.807749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 16/32] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:23.807749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88136-0f6e-4251-b843-d5c95fb0cdb9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.807749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88136-0f6e-4251-b843-d5c95fb0cdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.807749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b88136-0f6e-4251-b843-d5c95fb0cdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.811051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:23.813173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:23.823995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d8b88136-0f6e-4251-b843-d5c95fb0cdb9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:23.825221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d8b88136-0f6e-4251-b843-d5c95fb0cdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:06:23.830963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:23.831726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:23.833375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:06:23.833375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:06:23.833375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:06:23.833375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:23.833375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 17/33] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:23.837604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.868728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:23.895988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 17/34] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:23.897528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aeb8-8ce4-42a9-b863-d697e9c6ea5d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:23.897889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aeb8-8ce4-42a9-b863-d697e9c6ea5d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:23.898231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111aeb8-8ce4-42a9-b863-d697e9c6ea5d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:23.899559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 18/35] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:23.900306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111aeb8-8ce4-42a9-b863-d697e9c6ea5d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:23.959056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d73e1-a745-41e2-9704-5d552b79088b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:23.976075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:24.000503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:24.001202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.001489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.001767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.002522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:24.003915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:24.017965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111aeb8-8ce4-42a9-b863-d697e9c6ea5d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:24.056509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:24.057451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.057738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.058025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] PATH_INFO: `/v3/domains/default/users/ea7c343155f0487dbe56b20027ac902d/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.060096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ea7c343155f0487dbe56b20027ac902d, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:24.061589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57484b-1fc1-445f-a7aa-8810b33a2d25 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:24.209057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 18/36] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 12 07:06:23 2022] POST /identity/v3/roles => generated 219 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:24.209057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:24.262639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 19/37] 10.222.0.27 () {58 vars in 1361 bytes} [Tue Jul 12 07:06:23 2022] PUT /identity/v3/domains/default/users/ea7c343155f0487dbe56b20027ac902d/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:24.264586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.265132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.265382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.291901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:24.293886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:24.379097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:24.405593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd8c3e-334e-4da9-9420-2afad6651632 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:24.427660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 20/38] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:24.428310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:24.472206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:24.473876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.474611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.475111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.476100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:24.476864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:24.479572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:24.495574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 19/39] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:24.497011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:24.508102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:24.633663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b1cf1-b951-4944-bb34-584f1c4697cb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:24.673206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:24.673895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.674167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.674445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.675223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:24.676616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:24.700674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95b5e-9ff4-467e-98e6-8f9d1c0194a1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:24.740348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:24.740949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.741261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.741544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.742293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:24.743980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c3898-dea0-4354-adc0-129c086606ab None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:24.762218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 20/40] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 12 07:06:24 2022] POST /identity/v3/roles => generated 223 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:24.763064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:24.784560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:24.858629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 21/41] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 12 07:06:24 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:24.860494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38780f-ea46-409e-a72a-26c59cdf4075 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.860792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38780f-ea46-409e-a72a-26c59cdf4075 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.861174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38780f-ea46-409e-a72a-26c59cdf4075 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.863066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 22/42] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:24.869668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:24.869961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:24.870246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:24.913271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:24.914807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:24.947104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb24aca-714e-43fe-bf4b-4e5f83aff234 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:25.000010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:25.000702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:25.001089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:25.001453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:25.002261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:25.004724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:25.017695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:25.045256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:25.100281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:25.113055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 21/44] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:06:24 2022] POST /identity/v3/projects => generated 301 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:25.188421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff2e8c-4796-4d73-9e22-a2f9584d86d5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:25.229388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:25.230221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:25.230512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:25.230792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:25.232075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:25.233656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054a4e6-aaf1-4c65-a64d-5f3bceac7a18 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:25.235896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 24/45] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:25.241508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:25.306141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:25.351338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9861a33-40d2-4ef2-9d6d-75bc077acd52 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:25.390972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:25.391855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:25.392078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:25.392362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:25.393134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:25.395213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107972c-f876-41a0-8ecc-36f6ede74625 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:25.472151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 22/46] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:06:25 2022] POST /identity/v3/projects => generated 312 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:26.492561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba58c-77df-48ee-8b92-a84f509d8ed3 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:26.493099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba58c-77df-48ee-8b92-a84f509d8ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:26.493183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eba58c-77df-48ee-8b92-a84f509d8ed3 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:26.494567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 25/47] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:26.500345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:26.500763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:26.500945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:26.518243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:26.519767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:26.586777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 23/48] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:26.611118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eba58c-77df-48ee-8b92-a84f509d8ed3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:26.713837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eba58c-77df-48ee-8b92-a84f509d8ed3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:26.725060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:26.747652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:26.748380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:26.748668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:26.748949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:26.759354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:26.767557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:26.769263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:26.770857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 26/49] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:26.778243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:26.819785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:26.874948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a76b4-be5d-43c0-ae34-1828e95ef511 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:26.911548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:26.912210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:26.912495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:26.912772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:26.913560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:26.913869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:26.915240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:26.923398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 24/50] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:26.928837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:27.029362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0569-d9e5-4d5a-bba1-34828b16233f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:27.063292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:27.064157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.064443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.064721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.065938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:27.067383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:27.069013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 27/51] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:26 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:27.074649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:27.278711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb9d13-19d6-4b48-9893-4d7e228c65d8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:27.281146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:27.312307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:27.313310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.313861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.314155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.315338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:27.316785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd37973-a19c-4446-8749-4c5f5ffa2abd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:27.318601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 25/52] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:27.324367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:27.363744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:27.423564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac1fd2-f1fd-49b8-88ee-217e3d1c3f49 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:27.456648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:27.457333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.457618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.457892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.458754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.domain.id=default, user.id=ea7c343155f0487dbe56b20027ac902d) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:27.459065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:27.460504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9ae0a-5a38-4e93-9683-434eb209f971 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:27.466262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 28/53] 10.222.0.27 () {56 vars in 1322 bytes} [Tue Jul 12 07:06:27 2022] GET /identity/v3/role_assignments?user.id=ea7c343155f0487dbe56b20027ac902d&scope.domain.id=default&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:27.522081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd0f2-d540-4aa3-a456-029f05542178 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.522595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd0f2-d540-4aa3-a456-029f05542178 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.522674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fd0f2-d540-4aa3-a456-029f05542178 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.524022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 26/54] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:27.529723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.530218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.530322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.548433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:27.549617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:27.621809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 29/55] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:27.645844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd0f2-d540-4aa3-a456-029f05542178 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:27.745868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fd0f2-d540-4aa3-a456-029f05542178 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:27.778956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:27.779745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.780035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.780319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.782110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:27.783544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7a9b83-cf90-472b-9d5c-5f70679b99e5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:27.785222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 27/56] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:27.790733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:27.820572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:27.886859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e11873-92ee-414a-813e-9e09e6ddc559 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:27.919498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:27.920153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:27.920441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:27.920720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:27.922262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:27.923722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0eae56-342d-455f-ac74-10b5e7fdb1b0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:28.041890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Jul 12 07:06:27 2022] POST /identity/v3/projects => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:30.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fecf9-b6a7-4415-ab5a-8d4f956b8ab2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:30.048736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fecf9-b6a7-4415-ab5a-8d4f956b8ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:30.048838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fecf9-b6a7-4415-ab5a-8d4f956b8ab2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:30.050235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 28/58] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:30.055357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:30.055710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:30.055923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:30.073004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:30.074198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:30.138014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:30.162215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fecf9-b6a7-4415-ab5a-8d4f956b8ab2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:30.205272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:30.260300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fecf9-b6a7-4415-ab5a-8d4f956b8ab2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:30.292519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:30.293835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:30.294122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:30.294400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:30.295578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:30.297122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f023b22-6e3c-4724-9085-53c977ecbf88 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:30.298719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 29/60] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:30.304153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:30.319361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:30.400438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f77c2f-0800-4782-9633-2890f2b4fc10 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:30.433515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:30.434178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:30.434466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:30.434747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:30.435458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:30.437579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63621949-e575-4390-bdf6-163cbb743d2f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:30.529352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 32/61] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:30 2022] POST /identity/v3/users => generated 275 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:33.634537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea574-5c9c-4882-b474-a8885fd61f8a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.635471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea574-5c9c-4882-b474-a8885fd61f8a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.635942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ea574-5c9c-4882-b474-a8885fd61f8a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.637515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 30/62] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:33.653714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.654537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.654965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.677165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:33.678587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:33.746248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85958-4e50-469b-9f1b-5667d4e1ddc8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.746769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85958-4e50-469b-9f1b-5667d4e1ddc8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.747199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d85958-4e50-469b-9f1b-5667d4e1ddc8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.749092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:33.754613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7be7-6746-4ad5-810b-7cb5667aac2b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.755108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7be7-6746-4ad5-810b-7cb5667aac2b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.755654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d7be7-6746-4ad5-810b-7cb5667aac2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.762186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:33.767109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 33/64] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:33.789222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-592d7be7-6746-4ad5-810b-7cb5667aac2b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:33.790711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-592d7be7-6746-4ad5-810b-7cb5667aac2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:33.792696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:33.904334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc939bf1-ab9c-49a8-b490-59183f7476ea None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:33.943463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:33.944589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.945096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.945553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.958627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:33.966179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 32/65] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:33.968472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:33.974051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 34/66] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:33.975360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:33.976679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85908-9172-4c55-a46d-8615fadba12b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.977208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85908-9172-4c55-a46d-8615fadba12b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.977687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85908-9172-4c55-a46d-8615fadba12b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:33.979638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 33/67] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:33 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:33.985335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:33.985854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:33.986332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.006824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:34.008849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:34.048149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.056021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.087572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ca95e-e334-4faf-8100-56cd906e02e8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.095871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 34/68] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:34.097125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.146782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.147703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.148139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.148421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.149236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:34.149553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.151093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ad35a-5cd7-4376-b55b-d585d9e2afdc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.160733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 35/69] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:34.165046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929eaa-e0ca-4c4d-83f0-f2d961a9403b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.165046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929eaa-e0ca-4c4d-83f0-f2d961a9403b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.165046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06929eaa-e0ca-4c4d-83f0-f2d961a9403b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.167727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 36/70] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:34.168501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929eaa-e0ca-4c4d-83f0-f2d961a9403b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.210202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4139bf-ca50-47fc-bf3f-34aa95fee808 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.247442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.248251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.248541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.248828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.260694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:34.270265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:34.271120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:34.271870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:34.272491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.278696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06929eaa-e0ca-4c4d-83f0-f2d961a9403b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.304950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.309081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.318008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.318817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.319106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.319384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.329932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b1714be6-7914-4c1c-bb2b-a7c49e1a0107 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:34.338257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:34.339302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:34.340257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:34.347897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 37/72] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:34.347897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.347897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.347897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.361882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:34.363062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:34.394190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234b535-e361-494a-adc3-d4f9f97c8b83 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.429065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 38/73] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:34.429846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.430735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.431617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.431910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.432204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.433446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.434914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.441178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 36/74] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:34.441178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.537164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.542554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245720a-f8b7-48e3-906c-668f472579f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.543957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29652f9d-fded-4c33-8ee8-2638dd562d94 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.557224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.575929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.576595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.576880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.577202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.578514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:34.578817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.578908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.579489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.579836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.580128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.580236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.580867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:34.581208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.582580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.588896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:34.588896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.593758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 39/76] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:34.593758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.689345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd60f7c1-077b-4b2e-807d-ef669973fc59 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.691301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea4909b-07f4-403f-9e3e-d489e9ba782c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.722904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be5778-1330-43f5-9143-b352034df728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.723562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5778-1330-43f5-9143-b352034df728 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.723853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5778-1330-43f5-9143-b352034df728 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.724283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be5778-1330-43f5-9143-b352034df728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.724801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.725613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.725896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.726196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.736251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8fb1f28e-7fc4-4063-a495-0d676b0476ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:34.743920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:34.744908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:34.745795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 40/77] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:34.746781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f725ae-4c16-4886-9037-ed96b1428112 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.746781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f725ae-4c16-4886-9037-ed96b1428112 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.746901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f725ae-4c16-4886-9037-ed96b1428112 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.748115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 41/78] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:34.750410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f725ae-4c16-4886-9037-ed96b1428112 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.756853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.786825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.798383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be5778-1330-43f5-9143-b352034df728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.799992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19be5778-1330-43f5-9143-b352034df728 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.853393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f725ae-4c16-4886-9037-ed96b1428112 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:34.886343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:34.887202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:34.887485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:34.887759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:34.897198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 38/79] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:34.898042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be5778-1330-43f5-9143-b352034df728 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.900900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:34.902394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:34.904218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 42/80] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:34.904850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:34.958926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:34.997857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.002623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be5778-1330-43f5-9143-b352034df728 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.006776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5318becd-7180-4b5e-933b-68c7bfe07a21 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.035290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.036168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.036461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.036743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.038006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.039453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6131ff4-cc0d-4561-bf29-1a2ad843522b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.041111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.041225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 39/81] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.041790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.042082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.042337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.042421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.042633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.042915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.043104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:35.043415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.044804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.054428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 43/82] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.055472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.059703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:35.060904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:35.127382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 40/83] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:35.128223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.156811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d1b66-0982-4d81-a2aa-1005c2fa4c34 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.191723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.192584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.192874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.193198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.194400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.195198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.195857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.198051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 44/84] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.198731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.226670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.240446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23752732-0a99-485b-bf81-8f3ceb2b3449 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.274661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.275316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.275606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.275888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.302336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111f03f-3edd-4815-97cc-e1e50db3e380 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.336273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.336933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.337251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.337537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.344123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.345625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.399301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.404778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.407324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.430919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.444217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 41/85] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:35.445068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.510364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 45/86] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:35.510960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.544917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc95b2-f2fa-4e85-ac01-209bfd6df8c9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.578136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39e5b-8623-440c-8386-92640010846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.579008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39e5b-8623-440c-8386-92640010846a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.579296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39e5b-8623-440c-8386-92640010846a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.579568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b39e5b-8623-440c-8386-92640010846a None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.580757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39e5b-8623-440c-8386-92640010846a None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.582225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b39e5b-8623-440c-8386-92640010846a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.583859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 42/87] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.588282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39e5b-8623-440c-8386-92640010846a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.609862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.610588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db912c-8708-4f35-80bd-f036cdb0081f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.632245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.644008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.644799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.645128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.645419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.646691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.648229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.650068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 46/88] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.650630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.684024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b39e5b-8623-440c-8386-92640010846a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.718453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.719113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.719402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.719686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.720532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=ea7c343155f0487dbe56b20027ac902d) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:35.720852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.722335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.730572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 43/89] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/role_assignments?user.id=ea7c343155f0487dbe56b20027ac902d&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.731370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.751030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309799fb-7f30-4bd6-a274-084dbdbbac00 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.788438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.789343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.789597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.789875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.791128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.792609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.794417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 47/90] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.795219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.855417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.861569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:35.872006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f3cc1-e974-4593-b3e7-b6fc16759b29 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.906514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d8996-094c-4c2f-9c04-af21c437d780 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:35.909273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.910137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.910427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.911573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:35.912538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:35.916583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:35.916583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 44/91] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:35.916583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:35.946660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:35.947317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:35.947850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:35.948131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.024314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8ed60-4d4d-4fa1-9cd0-29d7447f4bfd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:36.025646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.027384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.061543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:36.062256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:36.062626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:36.062971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.063771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.065243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.086996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:36.129123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 48/92] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:36.129971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:36.149188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 45/93] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:35 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:36.150083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:36.172242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:36.271690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f67c7-0ace-4620-bdef-2556a2fbecf1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:36.294968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1e0a7-0c40-492d-ab94-e61ff10993f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:36.313810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:36.314811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:36.315341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:36.315815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.316865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:36.317212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.318663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.325453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 49/94] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:36 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:36.326094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:36.338172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:36.339357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:36.339853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:36.340792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.341982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:36.342608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.345780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.354722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 46/95] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:36 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:36.363389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:36.456272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa4b959-09bb-437a-a22f-c6ae3f027e47 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:36.502274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:36.503448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:36.503884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:36.504310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] PATH_INFO: `/v3/projects/46b24737d7624e41b1f3a304d30c7e9d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.505789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] RBAC: Authorizing `identity:get_project(project_id=46b24737d7624e41b1f3a304d30c7e9d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.507518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0195e-32b2-4828-8881-d59c127463d2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.509626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 50/96] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:36 2022] GET /identity/v3/projects/46b24737d7624e41b1f3a304d30c7e9d => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:36.516181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:36.605928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:36.631425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6f207-f60b-42f4-84bd-246e15de4a1d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:36.668392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:36.669362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:36.669796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:36.670224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:36.672471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=46b24737d7624e41b1f3a304d30c7e9d, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:36.672946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:36.674680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257546b-079b-4e7f-843d-91a50378acab None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:36.685215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 47/97] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:36 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=46b24737d7624e41b1f3a304d30c7e9d&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:38.271084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46eea1-6e09-4de2-95b5-c1d003df8fb9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:38.271917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46eea1-6e09-4de2-95b5-c1d003df8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:38.272353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c46eea1-6e09-4de2-95b5-c1d003df8fb9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:38.273956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 51/98] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:38.279344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:38.280127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:38.281134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:38.302341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:38.303741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:38.386267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 48/99] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:38.423305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46eea1-6e09-4de2-95b5-c1d003df8fb9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:38.539827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:38.550972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c46eea1-6e09-4de2-95b5-c1d003df8fb9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:38.599019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:38.600090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:38.600512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:38.600992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:38.614006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:38.621934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:38.622997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:38.624434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:38.626404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 52/100] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:38.632423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:38.708613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:38.740487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2418b318-cecd-4feb-ae7a-48aad42a2cce None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:38.776187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:38.777116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:38.777539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:38.777979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:38.778871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:38.779319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:38.780893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:38.790779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 49/101] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:38.797304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:38.921580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee0d55-d0c4-4374-b839-ad7839499dd1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:38.964990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:38.965887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:38.966172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:38.966451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:38.975990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:38.975990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396dac-31ac-48e6-a227-4c4b559e9be8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:38.977149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 53/102] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:38 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:38.982656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.011250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154587-b4b3-479b-ba1c-53b21ee3a44d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.011546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154587-b4b3-479b-ba1c-53b21ee3a44d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.011816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5154587-b4b3-479b-ba1c-53b21ee3a44d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.013234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 54/103] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:39.024855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.025176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.025460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.055198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:39.056328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:39.085428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.199841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8424e4f-3977-4b6e-9532-a9cc83154e72 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.212213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 55/104] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:39.239875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.266119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.276067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.277253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.277540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.277822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.282833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:39.284022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:39.286341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 50/105] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:38 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:39.292204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.402243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b498244-43ae-4131-b315-1139c6d70d4f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.423272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8002b-88d0-4512-be65-05cf95260d1b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.440187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.441439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.441921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.442386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/ea7c343155f0487dbe56b20027ac902d/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.444542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, user_id=ea7c343155f0487dbe56b20027ac902d, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:39.446219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413dea8-831c-4d66-a9e9-f0729f7294d8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:39.473767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.475012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.475490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.476060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.487651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4f0d7f82-b1ad-4380-b5df-10ab23556c4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:39.496223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:39.500323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 56/106] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:39.501153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ed5c3-3a31-40c2-878b-6fda9dc4b5e1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.502293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ed5c3-3a31-40c2-878b-6fda9dc4b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.502786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8ed5c3-3a31-40c2-878b-6fda9dc4b5e1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.504538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 57/107] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:39.505450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ed5c3-3a31-40c2-878b-6fda9dc4b5e1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.524243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 51/108] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:39 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/ea7c343155f0487dbe56b20027ac902d/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:39.526061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2645d19-e7f3-48de-a77a-49b13c9ad7b4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.528618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2645d19-e7f3-48de-a77a-49b13c9ad7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.528618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2645d19-e7f3-48de-a77a-49b13c9ad7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.534829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.564955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d2645d19-e7f3-48de-a77a-49b13c9ad7b4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:39.566996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d2645d19-e7f3-48de-a77a-49b13c9ad7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:39.692100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.712269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 52/109] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:39.713695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff2a7-c2c9-45c8-8bcd-fd2b290e1c14 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.713992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff2a7-c2c9-45c8-8bcd-fd2b290e1c14 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.714274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdff2a7-c2c9-45c8-8bcd-fd2b290e1c14 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.715613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 53/110] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:39.723391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.723677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.723965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.746611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8ed5c3-3a31-40c2-878b-6fda9dc4b5e1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.758970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:39.763909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:39.790574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.791348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.791635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.791919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.792681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:39.793060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:39.794422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:39.804428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 58/111] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:39.805756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.839508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 54/112] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:39.840608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:39.884214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.918419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82bf69-b0ff-4839-9ff7-b6d95bee1bd3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.944679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2aa1e-3038-48cc-b6e3-d7ab8482007a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:39.959621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.960664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.961324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.961575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.973767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:39.977298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5677d11c-cf6d-40e1-a75d-06c036f561e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:39.985477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:39.990104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:39.991041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 59/113] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:39.991814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:39.991913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e14e3-f9e0-4a6b-bde4-665ad63e959a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.991990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:39.992064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e14e3-f9e0-4a6b-bde4-665ad63e959a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.992141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:39.992223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e14e3-f9e0-4a6b-bde4-665ad63e959a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.992299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] PATH_INFO: `/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:39.992472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 60/114] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:39.992472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e14e3-f9e0-4a6b-bde4-665ad63e959a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.011389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=81a53905a5634f1ca9ad3c1b80b6a9bd)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.013278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee12272-bafa-4e7b-8f1a-322b8e967ea9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.015985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 55/115] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:39 2022] GET /identity/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.017460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.017951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.018455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.036404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:40.037986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:40.102893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e14e3-f9e0-4a6b-bde4-665ad63e959a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.108527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 56/116] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:40.109659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.135335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.142125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.142996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.149428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.149428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.154591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:40.162902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:40.163764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:40.164522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 61/117] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:40.165802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.227142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9076b6-933c-4b6e-91f6-456e2c238818 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.238109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.263714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.264389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.265598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.266146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.267127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:40.267635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.269516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa430a-d86b-4581-a2d9-0eaf53b1aa81 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.271504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65f1fb-8122-41cb-9c8c-b9914afc32b0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.278002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 57/118] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.279233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab662-36b2-41ba-899e-c89177daa5c7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.279517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab662-36b2-41ba-899e-c89177daa5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.279799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cab662-36b2-41ba-899e-c89177daa5c7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.281565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 58/119] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:40.282113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cab662-36b2-41ba-899e-c89177daa5c7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.316355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.317013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.317320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.317663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.378752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.390485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.391986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515431af-4fae-4086-80a3-bad7bd063182 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.392379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cab662-36b2-41ba-899e-c89177daa5c7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.427387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.428180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.428465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.428749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.429946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.431394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.437777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 59/120] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.437777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.477960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.504874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 62/121] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:40.506358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.506654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.506930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.524901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:40.526113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:40.540161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60835d09-91cd-4eac-9bd5-1f00f5662b8b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.573962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.574635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.574918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.575195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.575946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:40.576257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.577832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.585868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 60/122] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.586557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.610049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 63/123] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:40.610825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.633439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.741312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:40.744254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccf02a1-74ec-40a9-9434-b92161d7bd5d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.747061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f3b8cd-9fdc-4064-bd64-0267dbd72ce2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.783300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.783965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.784245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.784519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.785257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.786639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.786752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.787688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.788066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.788440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.789867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.791284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.793241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 61/124] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.793914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.885678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 64/125] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:06:40 2022] POST /identity/v3/projects => generated 302 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:40.886873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:40.907907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974dc58-1656-423c-8fed-8d43e18864fe None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:40.959934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:40.960823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:40.961140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:40.961516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:40.963544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:40.965395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:40.974413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 62/126] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:40.974413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.004960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.019529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.034513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0ac5f-149e-4e80-813a-f27e6a356ba0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.079192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.081115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.081429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.082176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.083381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.085135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.087580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 65/127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:41.088195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.107028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8dbf4-6f0a-414a-8b10-376576b91257 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.151723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.152694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.153144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.153532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.165801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:41.174125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:41.175219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:41.176222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:41.178243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 63/128] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:41.179131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.235287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7cc44-e39a-487d-b356-8060f23e0267 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.276912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.278029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.278308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.278590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.279964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.282822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.290121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 66/129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:41 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:41.291252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.297677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.304529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4dc76-7cac-4268-8426-6b8f16f8f9f2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.304827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.351755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.352755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.353541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.353933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.354898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=81a53905a5634f1ca9ad3c1b80b6a9bd) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:41.355324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.357698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.365965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 64/130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:41 2022] GET /identity/v3/role_assignments?user.id=81a53905a5634f1ca9ad3c1b80b6a9bd&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=96fd41f487c34e308bb87a78c02854de => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:41.369932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.462155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae2dc0c-5976-43e7-9b69-80c3b70a569d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.518169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4fd16-4160-449a-8880-197a4bfda058 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.525399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.527487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.527933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.528859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.531269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.533616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.536911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 67/131] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:41 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:41.542032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.580624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.581515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.581919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.582215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.582991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:41.583307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.585659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.598395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 65/132] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:41.599281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.645385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.654199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:41.703350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1519655-e2e5-4690-b557-1ab40378745e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.740607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceae2d-5089-4578-af7b-924ca8d88b31 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:41.775494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.776404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.776696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.776965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.779041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, user_id=3c3b2f254edb4cf1bd1e958c56aa9af6, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.779632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:41.780482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.781310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.781810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.782280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.785796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, user_id=3c3b2f254edb4cf1bd1e958c56aa9af6, role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:41.787626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1d28a-456b-4252-b541-a77af7d789c7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:41.882173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:41 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:41.888960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:41.921346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 66/134] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:41 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/da841affa12f4aa58bdf9bf9f469204c => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:41.924234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ca59-cc6e-4dd3-a375-431864cc1170 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.924998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ca59-cc6e-4dd3-a375-431864cc1170 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.929005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed22ca59-cc6e-4dd3-a375-431864cc1170 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.931043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 67/135] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:41.938966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:41.939645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:41.940169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:41.969479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:41.975591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:42.095215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 68/136] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:42.122882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c34d9-455a-4e1e-98c6-56a50954d474 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.135126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:42.160254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:42.189811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.190988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.190988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.191287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.192595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:42.194203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:42.196940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 69/137] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:41 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:42.203701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:42.209551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:42.297294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef3f093-bcc1-4cbb-87b8-6cac1f9731ff None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.351767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10961ca-8edd-418b-96f4-5300dbf31dae None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.355062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.355775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.356065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.356340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.376254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:42.389409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:42.390842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:42.391597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:42.392176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 69/138] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:42.393110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.394228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.394699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.395172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] PATH_INFO: `/v3/projects/46b24737d7624e41b1f3a304d30c7e9d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.396630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] RBAC: Authorizing `identity:get_project(project_id=46b24737d7624e41b1f3a304d30c7e9d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:42.396843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:42.398662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:42.400839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 70/139] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:42 2022] GET /identity/v3/projects/46b24737d7624e41b1f3a304d30c7e9d => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:42.409299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:42.526583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:42.539826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:42.582293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48204b2-40d2-43e9-b4ab-0d2617a3179d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.604995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847955e5-c324-4798-9e0e-036dad6d6113 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.623135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.624085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.624368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.624658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] PATH_INFO: `/v3/projects/46b24737d7624e41b1f3a304d30c7e9d/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.627458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] RBAC: Authorizing `identity:create_grant(project_id=46b24737d7624e41b1f3a304d30c7e9d, user_id=3c3b2f254edb4cf1bd1e958c56aa9af6, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:42.628916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:42.666206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.666885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.667171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.667450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.668267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:42.668577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:42.669999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:42.681499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 70/140] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:42.687630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:42.721261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 71/141] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:42 2022] PUT /identity/v3/projects/46b24737d7624e41b1f3a304d30c7e9d/users/3c3b2f254edb4cf1bd1e958c56aa9af6/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:06:42.834690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d3c18-4675-4381-ab30-0eb3828c6139 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:42.881075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:42.882291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:42.882775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:42.883256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] PATH_INFO: `/v3/users/ea7c343155f0487dbe56b20027ac902d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:42.884654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] RBAC: Authorizing `identity:get_user(user_id=ea7c343155f0487dbe56b20027ac902d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:42.890647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:42.893219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 71/142] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:42 2022] GET /identity/v3/users/ea7c343155f0487dbe56b20027ac902d => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:42.898472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:43.067777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05039c-8f7e-41d3-8717-00df20c94b95 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:43.106368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:43.111962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:43.112678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:43.112966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:43.113267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:43.196365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:43.198159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb235c9-8294-4a3f-883b-d2fe4726c81d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:43.321813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:43.328242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:43.333884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:43.455495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168c2d0-b043-47ab-8e01-f698b4cfa541 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:43.497944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:43.499335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:43.499632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:43.499914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:43.501388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:43.501995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8307-098c-486b-8d0f-11fe18105b2e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:43.502289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8307-098c-486b-8d0f-11fe18105b2e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:43.502571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8307-098c-486b-8d0f-11fe18105b2e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:43.502836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:43.503959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 73/144] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:43.504533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 72/145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:43 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:43.509109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:43.509402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:43.509685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:43.511691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:43.542138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:43.543394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:43.594911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:43.598576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:43.668828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880cd62-2e2a-4ed9-a028-e2c1f36b972f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:43.687838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 74/146] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:43.734720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:43.735317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:43.735607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:43.735894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:43.736753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=ea7c343155f0487dbe56b20027ac902d) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:43.737100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:43.738562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:43.739203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:43.750346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 73/147] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:43 2022] GET /identity/v3/role_assignments?user.id=ea7c343155f0487dbe56b20027ac902d&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:43.967855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87808a-2e6f-46bf-8585-e1d47aa37b54 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:44.022790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:44.023532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.023812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.024086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.025309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:44.026787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68c53c-b5f7-40d1-b929-2141b4c38316 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:44.028468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 75/148] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:44.034178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:44.183738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77fcd-1e1b-479d-9001-9a8e4b9f9b0d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:44.220625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:44.221645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.222195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.222757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.223709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:44.225397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d084d-00de-42a5-aee5-c4d220a8e31c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:44.235641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:44.319862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 74/149] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:44 2022] POST /identity/v3/users => generated 283 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:44.438632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1cf00-6972-45a1-9047-96086ab73d65 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.439045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1cf00-6972-45a1-9047-96086ab73d65 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.439221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1cf00-6972-45a1-9047-96086ab73d65 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.440834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 76/150] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:44.446565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.446874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.447140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.474568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:44.475788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:44.569135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 75/151] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:44.592374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1cf00-6972-45a1-9047-96086ab73d65 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:44.631411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:44.732649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1cf00-6972-45a1-9047-96086ab73d65 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:44.778325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:44.779470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.779966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.780608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.795057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-89afddee-719c-4aba-a96b-3df91e5dab31 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:44.803836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:44.804684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:44.805503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:44.808514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 77/152] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:44.815194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:44.870183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdf52-910c-4bd3-8854-b2b1b49571f2 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.870800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdf52-910c-4bd3-8854-b2b1b49571f2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.871278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcdf52-910c-4bd3-8854-b2b1b49571f2 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.873236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 78/153] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:44.879053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:44.879314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:44.879578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:44.903446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:44.904630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:44.955503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691758f-cb68-4eb9-994d-5357dfe92f06 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:44.984362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.009628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.010672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.011288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.011777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.012752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:45.013360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.013873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 79/154] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:45.015364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.026276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 76/155] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:45.032724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.048183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.067892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.155974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e816bec-84f4-400c-b29f-b4c86a5c3a28 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.162610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39972bb-5dbf-4e4f-a20d-9680c574d896 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.196339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.198137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.198775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.199372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] PATH_INFO: `/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.200541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.205051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.205051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.205051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.205312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] RBAC: Authorizing `identity:get_user(user_id=81a53905a5634f1ca9ad3c1b80b6a9bd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.206922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.208646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 80/156] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:45.214213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.229015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:45.239686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:45.240620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:45.241435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 77/157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:45.248479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.331519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.345387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.361610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec9265f-5cc3-4e42-b7b0-eeec0935eb42 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.404899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f761-5602-4874-b922-1c1de28d6bdb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.405260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.406566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.406973 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.407265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.409400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.411212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a66b1a-5db6-43a5-b279-1fb6ebae79bb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.413460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 81/158] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:45.414710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74b4e-94ec-4416-848b-f2fbe6f9f609 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.415009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74b4e-94ec-4416-848b-f2fbe6f9f609 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.415886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d74b4e-94ec-4416-848b-f2fbe6f9f609 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.417237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 82/159] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:45.420494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74b4e-94ec-4416-848b-f2fbe6f9f609 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.457766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.458488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.458773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.459049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.459818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:45.460132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.463032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0731e-6442-407e-8a83-4c56ba4f70b5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.473766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 78/160] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:45.479996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.480286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.480564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.503757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:45.504940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:45.551118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d74b4e-94ec-4416-848b-f2fbe6f9f609 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.595302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 79/161] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:45.595997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.596841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.597847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.598135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.598415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/81a53905a5634f1ca9ad3c1b80b6a9bd/roles/96fd41f487c34e308bb87a78c02854de` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.602501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, user_id=81a53905a5634f1ca9ad3c1b80b6a9bd, role_id=96fd41f487c34e308bb87a78c02854de)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.603969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd13e1a-1660-4ba9-a334-d5bc06df8d06 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.638735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.715190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 83/162] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:45 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/users/81a53905a5634f1ca9ad3c1b80b6a9bd/roles/96fd41f487c34e308bb87a78c02854de => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:45.716582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23971b2-667a-43d8-9251-8f67e8ae0da8 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.716922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23971b2-667a-43d8-9251-8f67e8ae0da8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.717228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23971b2-667a-43d8-9251-8f67e8ae0da8 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.718942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 84/163] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:45.719517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23971b2-667a-43d8-9251-8f67e8ae0da8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:45.720410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f00cc5-03e4-4cbc-bf05-acb887273a94 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.755909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:45.791539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.792852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.793161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.793430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.799692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:45.801260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00dbd5-e8e1-4204-96c7-8a94d17790b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:45.803171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 80/164] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:45.806297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.806579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.806853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.841229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:45.843836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:45.915040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23971b2-667a-43d8-9251-8f67e8ae0da8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:45.974210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:45.974980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:45.975263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:45.975535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:45.984068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 81/165] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:45.984752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.004906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:46.018126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:46.019080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:46.019840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:46.021149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 85/166] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:46.025431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.045412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.148397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.167843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36384142-1358-4a47-a8fb-dac9f1804ce5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:46.174370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05d723-108c-437e-b51d-22752bd3b31d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:46.214329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:46.215240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:46.215594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:46.215943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:46.229231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:46.239189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:46.240275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:46.241319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:46.245177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 86/167] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:46.245965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.254603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:46.255263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:46.255543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:46.255814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:46.389889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:46.391801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:46.432287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961278e-f2a3-4512-b582-aa1060bee29d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:46.448999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.491536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:46.492129 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:46.492414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:46.492690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:46.493478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:46.493785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:46.495186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:46.506494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.510474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 87/168] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:46.511278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.564502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 82/169] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:46.565210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.729871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd06f036-754e-449d-8220-6c83cc51768e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:46.776541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2d9fe-e923-4019-855a-fd486f28ab20 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:46.795281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:46.796512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:46.796792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:46.797081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:46.797902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:46.798205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:46.799803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:46.817002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 88/170] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:46.817874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.836422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.843752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:46.844628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:46.844905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:46.845201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:46.846645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:46.848101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:46.849964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 83/171] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:46.850522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:46.917521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:46.964808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d914f-c98f-432d-80e3-c42b1f044791 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.002897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.004121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.004625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.005143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.006563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.008203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:47.010449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 89/172] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:47.011606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:47.130148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c73508-35bd-4db3-83ad-741472a49e57 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.166209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e799a-e0b8-413c-afae-e5d25e612b0c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.167185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.168286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.168800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.169328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.173494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:47.248135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.250507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:47.292053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.292937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.293284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.293522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] PATH_INFO: `/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.294740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] RBAC: Authorizing `identity:get_user(user_id=3c3b2f254edb4cf1bd1e958c56aa9af6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.296409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:47.298401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 84/173] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:46 2022] GET /identity/v3/users/3c3b2f254edb4cf1bd1e958c56aa9af6 => generated 275 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:47.299190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:47.478244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:47.486094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 90/174] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:47.496142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:47.550937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:47.567864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eb58e-e60d-4cd6-913b-e61dd202ef57 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.653054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.653054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.653054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.653054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.653472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:47.653472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.654594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:47.662944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 85/175] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:47 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:47.664236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:47.741814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e7ea7-1fbb-4e53-8931-b7b92f3f4ecd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.814202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.815351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.815645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.815927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.854888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108d02e-1b71-4d9e-b507-90b7989e450b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:47.891876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:47.902324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:47.903590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.904073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.904543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.909834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.911621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd2907-4038-4a79-9cf2-f83bb4f37150 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:47.916116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 86/176] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:47 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:47.924081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d8b6-9ec8-4b12-b03b-06018e149230 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:47.924655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d8b6-9ec8-4b12-b03b-06018e149230 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:47.925926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7d8b6-9ec8-4b12-b03b-06018e149230 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:47.930862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 87/177] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:47 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:47.931832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7d8b6-9ec8-4b12-b03b-06018e149230 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:47.979278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:47.980779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fb5873-dbb7-462b-9bec-383c3b8a353f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:48.038785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.128872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7d8b6-9ec8-4b12-b03b-06018e149230 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.181550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 91/178] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 695 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:48.182886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd4a2-c390-44a9-8698-8e24a104ba2f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.183180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd4a2-c390-44a9-8698-8e24a104ba2f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.183454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebd4a2-c390-44a9-8698-8e24a104ba2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.193010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.193735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.194014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.194293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.195154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:48.195472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:48.197226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f083bd-1fdc-45a0-b7d3-15cb2c94b960 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:48.203860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f1ebd4a2-c390-44a9-8698-8e24a104ba2f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:48.205306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f1ebd4a2-c390-44a9-8698-8e24a104ba2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:48.208168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 88/179] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:47 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:48.210125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500015-1439-4bda-b889-82b6bd1db2d6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.210125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500015-1439-4bda-b889-82b6bd1db2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.213578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51500015-1439-4bda-b889-82b6bd1db2d6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.215277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 89/180] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:48.219589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500015-1439-4bda-b889-82b6bd1db2d6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.299992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 92/181] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:48.305152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.305493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.305770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.341477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.353104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:48.354233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:48.356898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51500015-1439-4bda-b889-82b6bd1db2d6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.411466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.412775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.413323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.413824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] PATH_INFO: `/v3/projects/46b24737d7624e41b1f3a304d30c7e9d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.417374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] RBAC: Authorizing `identity:get_project(project_id=46b24737d7624e41b1f3a304d30c7e9d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:48.420230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:48.423242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 90/182] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/projects/46b24737d7624e41b1f3a304d30c7e9d => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:48.424513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.430195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.446406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 93/183] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:48.447713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.549398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d30c6b-9d3d-4ddd-837c-6530ce8f4c5f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.584083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.589810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.595608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.595608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.595608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.603303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:48.604022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ffc8a-2033-437d-9bea-ba146235a0cf None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:48.612915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:48.614012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:48.614968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:48.617187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 91/184] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:48.622590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.645760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.646812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.647099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.647376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.648217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=46b24737d7624e41b1f3a304d30c7e9d, user.id=3c3b2f254edb4cf1bd1e958c56aa9af6) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:48.648527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:48.650007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:48.660293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 94/185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/role_assignments?user.id=3c3b2f254edb4cf1bd1e958c56aa9af6&scope.project.id=46b24737d7624e41b1f3a304d30c7e9d&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:48.661183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.745426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.756272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc6adf-ffb7-4205-bbf4-509dd1cbbece None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.796281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.797446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.798168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.798620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.811042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8655c-9863-4f58-9160-7a492be9c3bf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.815556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c14efa14-89ce-47a0-9671-f508d4216088 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:48.823953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:48.824905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 92/186] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:48.826835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ca1e-e0a7-4a68-b17d-1a00ee51dbdc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.828145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ca1e-e0a7-4a68-b17d-1a00ee51dbdc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.828145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77ca1e-e0a7-4a68-b17d-1a00ee51dbdc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 93/187] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff242-f301-4b5f-964b-cdffd29bb72f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff242-f301-4b5f-964b-cdffd29bb72f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ff242-f301-4b5f-964b-cdffd29bb72f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 94/188] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:48.833080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ff242-f301-4b5f-964b-cdffd29bb72f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:48.862512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.863937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.864214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.864662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.865278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:48.866385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:48.867782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9455ae6-1039-460b-bb44-fc44bdacdf3f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:48.878113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 95/189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:48.878805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8218-850f-439d-a6f0-e6f3d8290e64 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.879100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8218-850f-439d-a6f0-e6f3d8290e64 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.879380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8218-850f-439d-a6f0-e6f3d8290e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.897532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-945b8218-850f-439d-a6f0-e6f3d8290e64 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:48.898672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:48.899115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-945b8218-850f-439d-a6f0-e6f3d8290e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:48.949831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ff242-f301-4b5f-964b-cdffd29bb72f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:48.975332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 96/190] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:48.976587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.976877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.977184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.990050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:48.990718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:48.991023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:48.991268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:48.992028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:48.992333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:48.993747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.006804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 95/191] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.006995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:49.007090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.007178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:49.044185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.070824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 97/192] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:49.071647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.103134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce8f38-5085-4e2f-8970-8c9ef4bee69b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.117459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.136714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.137612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.137896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.138169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.152780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.154278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.156713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 96/193] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.156713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.178809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac235c17-87b1-406f-ba24-48e6a76e5465 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.212919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.213753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.214040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.214318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.225432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:49.233470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:49.234322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:49.235110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 98/194] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:49.235758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.260705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88ce0e-86e0-4ab3-aa02-f8fe01f1e3c5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.269750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.296256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.297159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.297449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.297725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.298933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.300373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.302112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 97/195] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.305829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.334333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3e373-ec9f-400a-b5b4-0877a928cdc0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.348728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.368620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.369452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.369737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.370012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.371169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.372778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.374878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 99/196] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.375663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.408178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e84cb-b476-4da4-990b-3df5e82eb42e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.443194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.443846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.444127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.444404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.475641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d31170-ca9e-465c-bfdc-114a9624c1d4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.477487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.509885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.510553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.510836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.511109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.511859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:49.512166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.512651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.513600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.514142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.521728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 100/197] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.522523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.559114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.617543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 98/198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:49.618360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.621684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920054c1-cbd9-4c8e-84f1-1a4796a0f23b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.655293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.655934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.656215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.656489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.686659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.717286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539aca85-edd0-4099-9e20-1e63f7c76c38 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.723896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.725369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.751542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.752203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.752486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.752765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.753525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.754959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.765335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.825167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 101/199] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:49.826014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.855047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 99/200] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:49 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:49.855938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:49.902698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:49.944623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c397882-41b4-4f21-9a51-ce0de8fa46fd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.978827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf30338-31fc-443a-84e6-4f43f6f5d9fa None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:49.985878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:49.987009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:49.987447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:49.987719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] PATH_INFO: `/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:49.988999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] RBAC: Authorizing `identity:get_user(user_id=81a53905a5634f1ca9ad3c1b80b6a9bd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:49.990489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:49.996679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 102/201] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/users/81a53905a5634f1ca9ad3c1b80b6a9bd => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:49.996679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.026123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.026995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.027278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.027552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.028730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.030318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.032715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 100/202] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:50.032913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.112056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:50.123252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eefd40-e2f0-4ffa-99ca-7fbd9067c952 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.163800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e4b4a-76a4-4caa-8124-c223255fdbac None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.164754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:50.174981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.175159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.175786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.176067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.178011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.178925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.180646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 103/203] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:49 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:50.181460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.204513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.205525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.206016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.206474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.294078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.295380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.301668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e72cb4-5230-472f-8bd7-30540e1a127b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.347847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.349091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.349547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.350018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.351022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=a35db50e56fe44a689d45bafcc240f76) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:50.351931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.353846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.361336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:50.362890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 104/204] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:50 2022] GET /identity/v3/role_assignments?user.id=a35db50e56fe44a689d45bafcc240f76&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:50.363893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.442151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:50.455965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 101/205] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:50.461786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.490880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b6b45-94b4-4961-9835-3d7644a952f8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.545725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.546914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.548658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.549159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.550949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=a35db50e56fe44a689d45bafcc240f76) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:50.554024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.555752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.570375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 105/206] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:50 2022] GET /identity/v3/role_assignments?user.id=a35db50e56fe44a689d45bafcc240f76&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:50.644951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb4b6b-7691-4516-8b4e-b3fe44c4e49d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.702361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.703551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.704007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.704446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.705918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.707590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb216f5-5e41-4ff7-b87b-a51d7b839c3f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.709613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 102/207] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:50 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:50.715484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:50.822851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d10c3-016a-42ca-b697-3cbb564536c8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:50.851260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:50.859908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:50.860814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:50.861296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:50.861759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:50.862842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2, user.id=81a53905a5634f1ca9ad3c1b80b6a9bd) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:50.863330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:50.865010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898eeb1-12a9-403b-8e4a-03cad36ae2f6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:50.871463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 106/208] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:50 2022] GET /identity/v3/role_assignments?user.id=81a53905a5634f1ca9ad3c1b80b6a9bd&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=96fd41f487c34e308bb87a78c02854de => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:52.224071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512384a4-e671-43ff-9708-3942917cbb3c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.225095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512384a4-e671-43ff-9708-3942917cbb3c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.225638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512384a4-e671-43ff-9708-3942917cbb3c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.227256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 103/209] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:52.230218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811138b1-9954-4f42-8a96-5312ad0e3688 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.231036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811138b1-9954-4f42-8a96-5312ad0e3688 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.232477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.233526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.233630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811138b1-9954-4f42-8a96-5312ad0e3688 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.234124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.235296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 107/210] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:52.240755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.241331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.241809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.251812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:52.253010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:52.259505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:52.260924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:52.280977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:52.325001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 104/211] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:52.333059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 108/212] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:52.354287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.356464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.459532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c24aa-f9f0-4527-bbf3-25d2ce5eade3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:52.485847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d3e66-b908-443b-bfd5-34146ef8254c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:52.486625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:52.497683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:52.498606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.505122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.505122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.505122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:52.505122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:52.509121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 109/213] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:52.510743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.532015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:52.532998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.533323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.533599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.545852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-32e4aebd-6b42-4c47-94b6-43740f2b1ef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:52.553571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:52.554434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:52.555217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 105/214] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:52.556482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c00e6-444c-4fc7-a88e-b209492e8930 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.556482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c00e6-444c-4fc7-a88e-b209492e8930 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.556728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c00e6-444c-4fc7-a88e-b209492e8930 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.558127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 106/215] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:52.562408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c00e6-444c-4fc7-a88e-b209492e8930 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.592829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:52.630203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f6f9e1-e65c-4430-b11b-40e37269e458 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:52.723685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c00e6-444c-4fc7-a88e-b209492e8930 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:52.727361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:52.728193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.728617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.729105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.729952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:52.731529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:52.758157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:52.758728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.759011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.759289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.760042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:52.760350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:52.761772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92db558-e9da-4ce7-abd0-bafa2aaee051 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:52.771436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 107/216] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:52.772527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5df1-60f0-418c-bbf2-ae348fec7917 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.772815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5df1-60f0-418c-bbf2-ae348fec7917 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.773118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c5df1-60f0-418c-bbf2-ae348fec7917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.789629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-679c5df1-60f0-418c-bbf2-ae348fec7917 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:52.790806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-679c5df1-60f0-418c-bbf2-ae348fec7917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:52.823785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 110/217] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:52 2022] POST /identity/v3/users => generated 297 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:06:52.824728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.873073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 108/218] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:52.873073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be5e0-a03e-4ad8-ad0b-364c3d828c3c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.873073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be5e0-a03e-4ad8-ad0b-364c3d828c3c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.873073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9be5e0-a03e-4ad8-ad0b-364c3d828c3c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.873073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 109/219] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:52.875190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.875482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.875765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:52.883673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:52.894920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:52.896250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:52.906859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:52.946538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928178dc-494a-451e-83eb-ef81c21e986b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:52.977421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 110/220] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:52.982679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:52.993321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:52.994203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:52.994488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:52.994773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] PATH_INFO: `/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.011838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] RBAC: Authorizing `identity:get_user(user_id=eaf539a7527640a9aafbcc7dd93f5e0a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.013343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.015350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 111/221] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:52 2022] GET /identity/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.015998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.110685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a4358-9a66-430b-b99c-a9cfb5ea36ec None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.142017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb39a7-42ed-44c8-8044-5f209b2ad886 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.144937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.170103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.170553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.170843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.171119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.186352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:53.188847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.189937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.190440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.190962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:53.194307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:53.195174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:53.195956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 111/222] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:53.196617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.206779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.209456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:53.221769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:53.222709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:53.223479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:53.226424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 112/223] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:53.227519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.341308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2e03-4ced-46da-b4e4-7d071b0cc2b9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.347408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb6493-8d55-41c0-9955-1a10a87a224d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.378181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.378914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.379199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.379477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.380356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:53.380581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.382056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.394351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.395324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.395620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 113/224] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.396048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.396511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.396715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.431193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.486173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.487713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.505470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.528065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b199a-6c00-4365-9cc8-a16e19aba151 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.574043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.574980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.575637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.576059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.577493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:53.578192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.580358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.591650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 114/225] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.593454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.603126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 112/226] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:53.603126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.714051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.730589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4d74b9-a0fe-4e29-8601-9c68c320dcf1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.733578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a467174-9f09-4283-bdac-f5939b93bd07 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.736765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:53.772061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.773378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.774076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.774854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.776163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.777732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.784148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 113/227] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.784148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.784721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.786765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.787223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.787649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.789165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.790822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.793834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 115/228] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.794753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.899594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3770f68-be7e-473c-8887-981c89730bb0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.924447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8920-94c7-45d7-b696-bd6da9415dfd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:53.946544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.948307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.948904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.949451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.950982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.954217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.960631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 114/229] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.960631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:53.969233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:53.970204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:53.970554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:53.970895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:53.972159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:53.973715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:53.980260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 116/230] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:53.980260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:54.010060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:54.013567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:54.079227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2be371-c5c1-42aa-a5dc-e3974d19e4ec None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:54.098556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6558d-057d-4a97-ac94-12853d4ac3f3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:54.118367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:54.119330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:54.119613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:54.119885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:54.121116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:54.123104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:54.125116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 115/231] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:54.125874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:54.141077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:54.142140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:54.142631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:54.143212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:54.144308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=eaf539a7527640a9aafbcc7dd93f5e0a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:54.144945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:54.146672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:54.153524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 117/232] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:53 2022] GET /identity/v3/role_assignments?user.id=eaf539a7527640a9aafbcc7dd93f5e0a&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:54.154561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:54.258503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:54.273113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02eae01-236b-4a49-a480-7419fdc498c4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:54.324312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10769c-ab7d-4860-bd80-36fa8b6b5173 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:54.340685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:54.345074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:54.346650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:54.347112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:54.347547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/a35db50e56fe44a689d45bafcc240f76/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:54.351288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, user_id=a35db50e56fe44a689d45bafcc240f76, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:54.352745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b83868-9ca1-4d29-9441-9051f638a670 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:54.378436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:54.379934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:54.380420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:54.380872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/a35db50e56fe44a689d45bafcc240f76/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:54.383614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, user_id=a35db50e56fe44a689d45bafcc240f76, role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:54.385312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54660b79-1001-4bd1-aa04-189cf1f3cbed None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:54.423896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 118/233] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:54 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/a35db50e56fe44a689d45bafcc240f76/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:54.459224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 116/234] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:54 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/a35db50e56fe44a689d45bafcc240f76/roles/da841affa12f4aa58bdf9bf9f469204c => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:55.177875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ef2c-f827-4688-8005-f84cbdab2f95 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.178274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ef2c-f827-4688-8005-f84cbdab2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.178454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9ef2c-f827-4688-8005-f84cbdab2f95 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.180088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 119/235] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:55.208282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2a352-bfa8-424e-8353-11c2995371b1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.208578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2a352-bfa8-424e-8353-11c2995371b1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.208836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2a352-bfa8-424e-8353-11c2995371b1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.210513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 117/236] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:55.212028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.212317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.212590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.215056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.215375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.215664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.249091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:55.250211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:55.252960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:55.254130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:55.385408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 118/237] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:06:55.394442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 120/238] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:55.432172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:55.435036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:55.586839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:55.625007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:55.626933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6f77-8ebd-4cce-b826-64956905d42c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:55.631011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb200cd-d71a-4a6b-840f-4909c02e7e39 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:55.699131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:55.700239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.700525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.700794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.702107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:55.702903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.703179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.703449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.705955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:55.707419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:55.713668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 121/239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:55.719082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:55.725637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:55.750500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:55.751437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:55.752214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 119/240] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:55.757490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:55.872046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a907b-1b44-4f7f-af4b-65b45b8b6082 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:55.954363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:55.955071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:55.955360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:55.955642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:55.956375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:55.957873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:55.969987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ca5c9-d126-4aca-9d5e-9ac4a8342f4b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:56.007577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:56.008309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.008603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.008886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.009720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:56.010033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:56.011551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:56.021132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 120/241] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:56.026629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:56.050070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:56.080779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 122/242] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:55 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:06:56.148148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10de2595-2f89-424c-a263-b28f6e680ed1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:56.186313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:56.187205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.187487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.187761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] PATH_INFO: `/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.204077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] RBAC: Authorizing `identity:get_user(user_id=c7c9cbbfdb6d4c65b20898be64acb1fe)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:56.205599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd68941-7bcb-48b7-ac05-9d6cc6f772bf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:56.207690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 121/243] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:56.213523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:56.216772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:56.339686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895492b7-f504-4ce5-85d4-05044ba2c6dc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:56.378523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:56.379523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.380006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.380480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.458074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:56.459659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:56.461617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:56.466348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628040b-9531-48aa-b75d-5a73d60d5639 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.467249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628040b-9531-48aa-b75d-5a73d60d5639 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.467895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628040b-9531-48aa-b75d-5a73d60d5639 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.472745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 122/244] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:56.480448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.481000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.481507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.500936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:56.502531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:56.574647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 123/245] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:56.580645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 123/246] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:56.583357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:56.605549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:56.643949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:56.776329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a80e03-f5e9-495a-a3c1-843a87050c37 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:56.778173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:56.834847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:56.835419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4451fda6-4580-4c05-a9a2-e29fe3e984dc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:56.836213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.836690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.837157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.838533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:56.840131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:56.842412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 124/247] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:56.847883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:56.897949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:56.898753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:56.899039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:56.899317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:56.922484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:56.935897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:56.936881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:56.937691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:56.938296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 124/248] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:06:56.945113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.004642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675b32f-526c-4a3f-9ed3-9cb2225babfd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.041468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.070713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.071391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.071673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.071950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.073094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=c7c9cbbfdb6d4c65b20898be64acb1fe) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:57.073390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:57.074847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed83b4c-0f89-43b8-8cba-b94b86492f92 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:57.088123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 125/249] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/role_assignments?user.id=c7c9cbbfdb6d4c65b20898be64acb1fe&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=96fd41f487c34e308bb87a78c02854de => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:57.092201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23588e3-4844-4399-bd1b-f498ac443a52 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.100671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23e9-a828-42f5-8e89-bb4601e7fc2b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.100964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23e9-a828-42f5-8e89-bb4601e7fc2b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.101256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f23e9-a828-42f5-8e89-bb4601e7fc2b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.102905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 126/250] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:57.114538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545535-486e-4d84-8e4f-f7451e38b0d3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.114834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545535-486e-4d84-8e4f-f7451e38b0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.115094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c545535-486e-4d84-8e4f-f7451e38b0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.150346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3c545535-486e-4d84-8e4f-f7451e38b0d3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:57.151567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3c545535-486e-4d84-8e4f-f7451e38b0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:57.160036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.161066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.161542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.162028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.162996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:57.163490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:57.165088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:57.185069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 125/251] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:57.191331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.211131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.263469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 127/252] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:57.329134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fac67-1668-4374-a29c-011ddca011d6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.329423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fac67-1668-4374-a29c-011ddca011d6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.329650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fac67-1668-4374-a29c-011ddca011d6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.331395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 128/253] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:06:57.332162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fac67-1668-4374-a29c-011ddca011d6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.374754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d315d8a0-8b92-49c6-9e16-76e87f35421a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.405431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.412211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.413346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.413846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.414310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] PATH_INFO: `/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.415724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=eaf539a7527640a9aafbcc7dd93f5e0a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:57.417385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3cff1-2c13-4141-8830-e04b1fd80ea9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:57.419396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 126/254] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:57 2022] GET /identity/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:57.425404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.426265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.426503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.444292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:57.446700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:57.470669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fac67-1668-4374-a29c-011ddca011d6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.517372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.518178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.518460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.518740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.539941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:57.550322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:57.551185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:57.551982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 129/255] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:57.552623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.571780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 127/256] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:57.573741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.612470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.710604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb223cc6-0d18-48ef-963f-0ae102e6e6a1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.750614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.751743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.752028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.752300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.753562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:57.755028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:57.757196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 130/257] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:57 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:57.757988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.791767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860acc58-14a2-4e95-9209-7e35c78a0ab5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:57.856337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.878160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:57.878160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:57.878160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:57.878160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:57.878523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:57.878523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:57.879673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:57.892839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:57.897563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 128/258] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:57.898432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:57.912680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4a58c-9129-4aa0-8783-f26aa9cd8535 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.007360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7decf246-5903-413b-b13f-bc616a7b25ba None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.030314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.031292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.031589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.031874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.043674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.044845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.045419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.046327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/eaf539a7527640a9aafbcc7dd93f5e0a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.048549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, user_id=eaf539a7527640a9aafbcc7dd93f5e0a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:58.050243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:58.065056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:58.066721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:58.071626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 131/259] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:06:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:58.072935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:58.133641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 129/260] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:06:57 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/eaf539a7527640a9aafbcc7dd93f5e0a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:06:58.140324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:58.199809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f5a13-dda8-4f1c-a427-964eb271e0f7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.245434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:58.270967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.271891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.272179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.272562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.276302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:58.277818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:58.279628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 132/261] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:58.285969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:58.342873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:58.363783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5f543-b6a2-4635-895e-74d58e6f688c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.441505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.442256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.442548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.442826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.443597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:58.443905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:58.445339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:58.467652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 130/262] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:58.473315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:58.478813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e7ccc-8505-41de-9943-df3b69eadbac None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.516757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.517453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.517741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.518021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.591871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:58.594270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:58.617931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:58.661331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b622ca-8752-4099-9bb9-19c570f03906 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:58.731459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:58.778499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:58.779387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:58.780462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:58.780462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] PATH_INFO: `/v3/users/a35db50e56fe44a689d45bafcc240f76` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:58.781776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] RBAC: Authorizing `identity:get_user(user_id=a35db50e56fe44a689d45bafcc240f76)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:58.784172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:58.790398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 131/263] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/users/a35db50e56fe44a689d45bafcc240f76 => generated 283 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:06:58.791134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:58.819801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 133/264] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:58.826020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.030662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d85a-3976-49c3-9584-0e5213bd8621 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.067803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.068454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.068735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.069011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.104845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbffe8c-f19e-423f-b733-b0f23562436b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.120977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.145333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.145854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.149044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4688eba4-0de0-442c-9d5e-2a170a8eddf3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.183458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.184385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.184672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.184951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.188283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.189872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734f3e-6f7d-4147-a22c-c70b66129d7e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.191629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 134/265] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:59.197890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3696-0ba0-48b0-8789-94103becdbfd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.198191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3696-0ba0-48b0-8789-94103becdbfd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.198477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad3696-0ba0-48b0-8789-94103becdbfd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.203947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 135/266] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:59 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:59.204828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad3696-0ba0-48b0-8789-94103becdbfd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.300231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 132/267] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:06:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:06:59.302313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687cff8-73b9-4b39-8de0-4cb146762882 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.302608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687cff8-73b9-4b39-8de0-4cb146762882 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.303164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687cff8-73b9-4b39-8de0-4cb146762882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.322331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad3696-0ba0-48b0-8789-94103becdbfd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.325917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9687cff8-73b9-4b39-8de0-4cb146762882 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:59.327203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9687cff8-73b9-4b39-8de0-4cb146762882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:59.366710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.367381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.367914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.368195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.369753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=a35db50e56fe44a689d45bafcc240f76) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:59.370060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.371519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f97db-0d44-4af2-835f-baf735a95287 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.379995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 136/268] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/role_assignments?user.id=a35db50e56fe44a689d45bafcc240f76&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:59.381721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79994c3-6602-4683-8c3f-2ec0c07bc3f0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.382017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79994c3-6602-4683-8c3f-2ec0c07bc3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.382297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79994c3-6602-4683-8c3f-2ec0c07bc3f0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.388109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 137/269] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:59.389283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79994c3-6602-4683-8c3f-2ec0c07bc3f0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.457145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 133/270] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:59.460145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.460435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.460714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.500187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:06:59.501453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:06:59.510209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.510725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.595615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 134/271] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:06:59.596408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.617699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79994c3-6602-4683-8c3f-2ec0c07bc3f0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.662058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.662924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.663204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.663478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.664666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.666176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.668154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 138/272] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:59.668752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.728459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf2e74-3feb-4382-8176-e45b9cbd82dc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.777470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835731a5-038f-466d-879c-3b862399f735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.785047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835731a5-038f-466d-879c-3b862399f735 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.785047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835731a5-038f-466d-879c-3b862399f735 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.785047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835731a5-038f-466d-879c-3b862399f735 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.793057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e564cc1-446b-404b-9fc7-7aec1782fe1c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.793657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.798014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835731a5-038f-466d-879c-3b862399f735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-835731a5-038f-466d-879c-3b862399f735 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:06:59.808252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:06:59.809450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:06:59.812276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 135/273] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:06:59.817199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835731a5-038f-466d-879c-3b862399f735 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.824436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:06:59.838485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.839275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.839552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.839824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.840986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.842530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891fd3f2-a8b9-42d1-a2a3-bf06ef553c0a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.844187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 139/274] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:59.856062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e51a0-ad80-43b8-9711-49e0849af458 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.856062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e51a0-ad80-43b8-9711-49e0849af458 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.856062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46e51a0-ad80-43b8-9711-49e0849af458 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.856062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 140/275] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:06:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:06:59.856062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e51a0-ad80-43b8-9711-49e0849af458 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:06:59.922001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835731a5-038f-466d-879c-3b862399f735 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.960048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:06:59.960701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:06:59.960986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:06:59.961290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:06:59.962128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=a35db50e56fe44a689d45bafcc240f76) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:06:59.962443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:06:59.963384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46e51a0-ad80-43b8-9711-49e0849af458 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:06:59.963901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:06:59.973062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 136/276] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/role_assignments?user.id=a35db50e56fe44a689d45bafcc240f76&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:06:59.973616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.007770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.008453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.008734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.009009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.009815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:00.010128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.011555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c82bd5-98e7-45ba-8831-e2fc5b1cfbdf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.020813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 141/277] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:06:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:00.026936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.027229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.027505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.046491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:00.047708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:00.073470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:00.100656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:00.130966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 142/278] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:00.130966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.131995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91583b73-c0f3-4e80-8002-47bb0cf4a280 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.184179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.184858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.185176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.185458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.186894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.188610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.249970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4928089b-e4a6-4022-a2e0-8a793b3223af None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.286771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.287891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.288020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 137/279] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:06:59 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:00.288099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.288167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] PATH_INFO: `/v3/users/10e2f79f10fa43c7b8b577f61bed0bde` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.293167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.309162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] RBAC: Authorizing `identity:get_user(user_id=10e2f79f10fa43c7b8b577f61bed0bde)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.310702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.313017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 143/280] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/users/10e2f79f10fa43c7b8b577f61bed0bde => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:00.320553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.372769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:00.438992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c066092-6d17-4bcb-942d-8ce4f7def799 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.441367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1d7d-b554-40d3-b139-ff7203dfb7c9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.465883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:00.488614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.489373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.489660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.489934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.491630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.492305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.492567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.493133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.493704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, user.id=10e2f79f10fa43c7b8b577f61bed0bde, scope.system=all) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:00.494016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.495548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.503898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:00.504216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 144/281] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/role_assignments?user.id=10e2f79f10fa43c7b8b577f61bed0bde&scope.system=all&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:00.512035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:00.512985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:00.513832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:00.518757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 138/282] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:00.520230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.635390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65c3e60-5a3e-44cb-ae1f-461dc284251b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.637159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:00.685350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.686155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.686608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.686906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.687660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:00.687966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.689429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a3f1e-3a21-47ae-bb42-ceec84891d76 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.699363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 145/283] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:00.705817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.823561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe35be-45cb-4a36-b8a1-55a5ac29f474 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:00.832493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a021c-2246-4883-b8a7-1222dab81deb None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.832788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a021c-2246-4883-b8a7-1222dab81deb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.833086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a021c-2246-4883-b8a7-1222dab81deb None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.834741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 146/284] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:00.844857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.845199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.845484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.870487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:00.872155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:00.877206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:00.878100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:00.878382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:00.878659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] PATH_INFO: `/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:00.879902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c9cbbfdb6d4c65b20898be64acb1fe)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:00.885469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:00.890986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 139/285] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:00.898035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:00.985192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 147/286] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:00.991861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:01.011714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:01.065845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7a1b5-a3ca-476d-b275-bf5a5d40f546 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.132473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.133524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.133817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.134098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.135492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:01.136963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:01.140660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 140/287] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:00 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:01.146358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:01.225223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:01.236305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede03ab-268d-40bf-90a0-8064cada26c8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.298128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.298936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.299215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.299494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.320118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:01.337467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:01.338404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:01.339202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 148/288] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:01.350529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22e8b3e-6938-40c0-99ce-5da4f5b88cff None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.362038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:01.393396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:01.406969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.407960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.408247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.408529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/c7c9cbbfdb6d4c65b20898be64acb1fe/roles/96fd41f487c34e308bb87a78c02854de` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.412969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, user_id=c7c9cbbfdb6d4c65b20898be64acb1fe, role_id=96fd41f487c34e308bb87a78c02854de)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:01.414449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:01.509492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 141/289] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:01 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/users/c7c9cbbfdb6d4c65b20898be64acb1fe/roles/96fd41f487c34e308bb87a78c02854de => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:07:01.509943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab5cff-08af-4aa7-a684-a7d0e6538fb4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.551281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.551947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.552218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.552492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.553354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:01.553643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:01.555083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:01.567159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 149/290] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:01.573120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:01.691205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbb2d3-6896-4b67-974e-dec8c41b3447 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.727350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.728234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.728508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.728784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] PATH_INFO: `/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.730026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] RBAC: Authorizing `identity:get_user(user_id=eaf539a7527640a9aafbcc7dd93f5e0a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:01.731519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:01.737133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 142/291] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:01 2022] GET /identity/v3/users/eaf539a7527640a9aafbcc7dd93f5e0a => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:01.739339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:01.759388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:01.849341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746ef227-d738-4e1d-95a0-deb12a655240 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:01.885431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:01.886087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:01.886419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:01.886702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:01.963086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:01.964658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:01.983406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:02.074599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 150/292] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:02.076063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:02.139050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:02.204389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e6944-236f-41dd-a0ec-6ba3344949fb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:02.247003 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:02.247870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:02.248150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:02.249044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:02.250505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:02.251993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9315d5-64b5-4918-8b71-912bf5728ca7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:02.258268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 143/293] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:02 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:02.260094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:02.390583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca6e8a-2860-4853-a0a3-88d04d2f83b7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:02.407492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:02.425225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=eaf539a7527640a9aafbcc7dd93f5e0a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:02.432156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73f3ae-6f5b-4596-97db-99a5a2cbfd40 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:02.435128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 151/294] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:02 2022] GET /identity/v3/role_assignments?user.id=eaf539a7527640a9aafbcc7dd93f5e0a&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:02.966932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b55d-27e4-4581-a90e-14bcebc5583e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:02.972907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b55d-27e4-4581-a90e-14bcebc5583e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:02.973440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1b55d-27e4-4581-a90e-14bcebc5583e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:02.975324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 144/295] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:02.981056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:02.981890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:02.982367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.000419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:03.001917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:03.065374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b65e1-d24a-4891-ab29-cf22941e666d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.065993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b65e1-d24a-4891-ab29-cf22941e666d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.066483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b65e1-d24a-4891-ab29-cf22941e666d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.068294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 145/296] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:03.073700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.073990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.074274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.087850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 152/297] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:03.091798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:03.093596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:03.112331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.174385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 146/298] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:03.196747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.218485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230b162-da3a-4bb9-8e48-694ba03560c1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.229362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.243938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.256605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.257903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.258376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.258940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.272423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9d4c740a-4fbf-4bb0-b1c7-7edad01ecac6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:03.283179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:03.284077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:03.284853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:03.291404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 153/299] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:03.291404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d107-39de-4bee-bcdc-918b5feb74be None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.291404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d107-39de-4bee-bcdc-918b5feb74be None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.291404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf6d107-39de-4bee-bcdc-918b5feb74be None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.291404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 154/300] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:03.294506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6d107-39de-4bee-bcdc-918b5feb74be None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.308429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1909e1b-e3d7-4d78-8998-f5e63a926488 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.347489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.348303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.348583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.348854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.350207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.351478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d17bf-f896-4f41-a9f9-e0ff5d2b2918 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.353320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 147/301] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:03.354283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.354616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.354876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.372179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:03.373441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:03.411587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf6d107-39de-4bee-bcdc-918b5feb74be None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.449794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.450474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.450760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.451040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.452371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:03.452684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.454115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.457391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 148/302] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:03.458683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.462820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 155/303] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:03.468927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.502696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.504551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.566528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51992df9-bd32-4501-a90d-adbd80fbac53 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.581448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1a86-efad-4766-9ab1-a138f783fc86 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.609097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.610175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.610458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.610991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] PATH_INFO: `/v3/groups` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.611927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.614073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.617452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.618327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.618606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.618937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] PATH_INFO: `/v3/users/10e2f79f10fa43c7b8b577f61bed0bde` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.620292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] RBAC: Authorizing `identity:get_user(user_id=10e2f79f10fa43c7b8b577f61bed0bde)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.621735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.623428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 156/304] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/users/10e2f79f10fa43c7b8b577f61bed0bde => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:03.624732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.701242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 149/305] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Jul 12 07:07:03 2022] POST /identity/v3/groups => generated 229 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:03.702659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.730515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.735162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce484d-905e-46bc-b072-5c349e4b7797 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.781054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.782064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.782418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.782765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.796957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:03.805286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:03.806266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:03.807057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:03.811944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 157/306] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:03.813000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:03.856982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76009c34-ce24-44de-b662-3cf2483facc0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.860807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:03.898840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.899449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.899734 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.900013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] PATH_INFO: `/v3/system/users/10e2f79f10fa43c7b8b577f61bed0bde/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.901809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10e2f79f10fa43c7b8b577f61bed0bde, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.903258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0deb8-2ebf-460c-b06d-24a7e76f85b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.938913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd911-727a-4df1-ac8b-74266baec7c4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:03.975406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:03.976089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.976387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.976645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.981155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:03.981155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:03.981155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e3c5c2-a2cc-4e3c-bc55-22541d157e07 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:03.988568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 158/307] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:03.989859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa564b-8f30-46cf-a7f8-458ccdeb5afa None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:03.990145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa564b-8f30-46cf-a7f8-458ccdeb5afa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:03.990420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa564b-8f30-46cf-a7f8-458ccdeb5afa None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:03.991654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 159/308] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:03.994366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa564b-8f30-46cf-a7f8-458ccdeb5afa None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.000858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 150/309] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Jul 12 07:07:03 2022] PUT /identity/v3/system/users/10e2f79f10fa43c7b8b577f61bed0bde/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:04.002444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.002973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.003454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.023950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:04.025128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:04.026137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:04.118795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa564b-8f30-46cf-a7f8-458ccdeb5afa None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.132669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 151/310] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:04.155950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.163718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.164604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.164885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.165197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] PATH_INFO: `/v3/users/fc7c0e501764441fb89a370283e4e764` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.181653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] RBAC: Authorizing `identity:get_user(user_id=fc7c0e501764441fb89a370283e4e764)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:04.183576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:04.186399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 160/311] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:03 2022] GET /identity/v3/users/fc7c0e501764441fb89a370283e4e764 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:04.192346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.280334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2819ea-c5f6-4dc0-8235-c2b1fda72571 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.285453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:04.294997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:04.316958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392f33f-ec80-4c3d-b53d-a71301f12a22 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.324860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.326263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.327165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.327506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.342054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:04.352246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:04.353374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:04.354379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:04.356082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 152/312] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:04.362060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.362546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.362777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.363069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.363345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.364189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, user.id=fc7c0e501764441fb89a370283e4e764, scope.system=all) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:04.364503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:04.365977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:04.378075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 161/313] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 12 07:07:04 2022] GET /identity/v3/role_assignments?user.id=fc7c0e501764441fb89a370283e4e764&scope.system=all&role.id=96fd41f487c34e308bb87a78c02854de => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:04.482338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6cf075-188c-4b1d-8bc3-186d666b667e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.523543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.524226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.524514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.524802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.525603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:04.525914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:04.527303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:04.537581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 153/314] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:04.543064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.644794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfaa7e0-b959-4f02-b6ed-ba2cb8530b91 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.679231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.680164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.680446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.680722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] PATH_INFO: `/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.681958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] RBAC: Authorizing `identity:get_user(user_id=c7c9cbbfdb6d4c65b20898be64acb1fe)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:04.683392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:04.685062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 162/315] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:04 2022] GET /identity/v3/users/c7c9cbbfdb6d4c65b20898be64acb1fe => generated 297 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:04.691602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:04.712097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:04.800654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cacf4-ef73-4e6d-9b47-8cf0835ea366 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:04.837110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:04.837769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:04.838053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:04.838328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:04.907879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:04.909376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:04.928271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:05.015792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 154/316] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:05.021630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:05.036916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:05.123986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303985d-7c91-4dde-b609-e888e59b4971 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:05.158797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:05.159666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:05.159951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:05.160232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:05.161532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:05.163025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3419096e-f7e7-44c6-b920-7bc68fa10564 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:05.169127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 163/317] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:05 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:05.170976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:05.276175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2edd63-3df4-41ac-add0-bdc9b6933344 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:05.294113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:05.312975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:05.313946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:05.314453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:05.314927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:05.315967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc, user.id=c7c9cbbfdb6d4c65b20898be64acb1fe) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:05.316558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:05.318313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad4b8c-a8a9-4b9a-ad31-9a62d29c0cac None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:05.325115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 155/318] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:05 2022] GET /identity/v3/role_assignments?user.id=c7c9cbbfdb6d4c65b20898be64acb1fe&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=96fd41f487c34e308bb87a78c02854de => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:05.897357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb975f6-4e62-41bc-9350-6d0bf2223b4f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:05.897732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb975f6-4e62-41bc-9350-6d0bf2223b4f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:05.897911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb975f6-4e62-41bc-9350-6d0bf2223b4f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:05.899348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 164/319] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:05.904334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b2d-4455-4619-9c33-8eec2e49373e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:05.904695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b2d-4455-4619-9c33-8eec2e49373e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:05.904980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f0b2d-4455-4619-9c33-8eec2e49373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:05.922528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1f5f0b2d-4455-4619-9c33-8eec2e49373e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:05.923722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1f5f0b2d-4455-4619-9c33-8eec2e49373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:05.996538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 156/320] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:06.019744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb975f6-4e62-41bc-9350-6d0bf2223b4f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.100985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.120254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb975f6-4e62-41bc-9350-6d0bf2223b4f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.138119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f5ee-1025-4ac1-a82b-b45b0cb7d07f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.138432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f5ee-1025-4ac1-a82b-b45b0cb7d07f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.138687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0f5ee-1025-4ac1-a82b-b45b0cb7d07f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.140361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 157/321] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:06.145043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.145399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.145631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.156782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.157578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.157829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.158105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.159307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:06.160759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:06.162588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 165/322] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:06.163706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:06.164886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:06.167993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.240336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 158/323] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:06.263501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.277355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b39db9-0da2-4f31-abf1-f7b99c430f5c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.308427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.314608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.315281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.315567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.315845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] PATH_INFO: `/v3/groups` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.316536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:06.318068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:06.367284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05105f5-ca79-4be6-b502-c87487376803 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.400275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.401101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.401388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.401662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.413668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:06.419917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 166/324] 10.222.0.27 () {60 vars in 1134 bytes} [Tue Jul 12 07:07:06 2022] POST /identity/v3/groups => generated 226 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-47cc30f5-ba61-4646-a83b-09d0e467e1b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:06.420725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:06.421772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:06.428791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 159/325] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:06.430900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.441565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4ae8-7823-479c-a1e7-427eaa715340 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.441864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4ae8-7823-479c-a1e7-427eaa715340 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.442123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d4ae8-7823-479c-a1e7-427eaa715340 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.443567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 160/326] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:06.445159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.449837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.450185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.450472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.468785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:06.470081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:06.546401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 161/327] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:06.549051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c1972-9039-4d0a-a4cf-7cf3fd112c28 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.570300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.603603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.603603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.603603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.603603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.604114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:06.604114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:06.604114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:06.608235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.612724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 167/328] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:06.617185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.741303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de946a3-54e5-4916-8a9b-98cb2865a087 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.744426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.782663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b437f9-8ec5-4fd9-ad90-55c3cf6b07e8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.786423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.787245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.787532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.787811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.800650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:06.809312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:06.810249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:06.811741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 162/329] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:06.818582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.834992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:06.835950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:06.836235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:06.836960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] PATH_INFO: `/v3/users/10e2f79f10fa43c7b8b577f61bed0bde` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:06.838568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=10e2f79f10fa43c7b8b577f61bed0bde)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:06.840282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:06.843037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 168/330] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/users/10e2f79f10fa43c7b8b577f61bed0bde => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:06.848672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:06.944036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:06.958980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16555c0c-6dd0-4f3b-8cf2-1c656bcb6014 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:06.979481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc23f0f-8f91-4ad1-ab15-32fba3fa4fe5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:07.006154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:07.006751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:07.007355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:07.007355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:07.008059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:07.008372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:07.010541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:07.021777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 163/331] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:07.024657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:07.025530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:07.026002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:07.026451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:07.027530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] RBAC: Adding query filter params (role.id=e5ea235ccd4840438ecdecc166e6794e, user.id=10e2f79f10fa43c7b8b577f61bed0bde, scope.system=all) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:07.028022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:07.028207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:07.029915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:07.036610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:07.047518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 169/332] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 12 07:07:06 2022] GET /identity/v3/role_assignments?user.id=10e2f79f10fa43c7b8b577f61bed0bde&scope.system=all&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:07.150567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9fe23-b806-41bc-b78d-4eeb25737b87 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:07.190170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:07.191386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:07.191866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:07.192330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] PATH_INFO: `/v3/users/fc7c0e501764441fb89a370283e4e764` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:07.193882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] RBAC: Authorizing `identity:get_user(user_id=fc7c0e501764441fb89a370283e4e764)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:07.195558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515d449-f8c9-4411-9f73-063ffb63dd26 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:07.197506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 164/333] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:07 2022] GET /identity/v3/users/fc7c0e501764441fb89a370283e4e764 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:07.204223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:07.318361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0000f8c-1a94-4ad9-9c88-1b7e298d461b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:07.364580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:07.365483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:07.365766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:07.366036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] PATH_INFO: `/v3/system/users/fc7c0e501764441fb89a370283e4e764/roles/96fd41f487c34e308bb87a78c02854de` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:07.368408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fc7c0e501764441fb89a370283e4e764, role_id=96fd41f487c34e308bb87a78c02854de)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:07.369912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ed864-7c30-4c98-9262-74cff3fc66b7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:07.444450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 170/334] 10.222.0.27 () {58 vars in 1334 bytes} [Tue Jul 12 07:07:07 2022] PUT /identity/v3/system/users/fc7c0e501764441fb89a370283e4e764/roles/96fd41f487c34e308bb87a78c02854de => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:08.742469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceee3-5274-4c74-8af6-34e48d71a8af None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:08.743506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceee3-5274-4c74-8af6-34e48d71a8af None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:08.743996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dceee3-5274-4c74-8af6-34e48d71a8af None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:08.745643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 165/335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:08.751288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:08.751717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:08.751914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:08.786098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:08.787296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:08.863485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:08.875619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 171/336] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:08.912842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dceee3-5274-4c74-8af6-34e48d71a8af None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:08.941673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:09.046724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dceee3-5274-4c74-8af6-34e48d71a8af None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:09.088462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:09.089299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:09.089585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:09.089863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:09.101531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f91cd450-8d8e-4953-af9d-a6d938953769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:09.113738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:09.114635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:09.115853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 166/337] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:09.120967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:09.369203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f9d73-2f7e-4558-85bb-09ee2cbb7629 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:09.401179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d6c5-f690-4e30-ba16-725fb99eaf36 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:09.401468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d6c5-f690-4e30-ba16-725fb99eaf36 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:09.401933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d6c5-f690-4e30-ba16-725fb99eaf36 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:09.403813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 167/338] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:09.409071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed512-1632-4678-939b-92878e242b4d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:09.409627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed512-1632-4678-939b-92878e242b4d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:09.410116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ed512-1632-4678-939b-92878e242b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:09.449401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:09.450330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:09.450759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:09.451212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:09.452852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:09.453334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:09.454866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:09.461887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f65ed512-1632-4678-939b-92878e242b4d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:09.463247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f65ed512-1632-4678-939b-92878e242b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:09.479337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 172/339] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:09.485281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:09.590065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:09.651080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 168/340] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:09.759552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed512-1632-4678-939b-92878e242b4d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:09.782301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:09.803386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d50a79-eb65-45e3-be39-c019019f035e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:09.913724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:09.914645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:09.915388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:09.915877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.011347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ed512-1632-4678-939b-92878e242b4d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:10.067027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:10.068550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa7369-38f4-430e-82c3-3731e4450803 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:10.086144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:10.086964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.087251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.087528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.113268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d4604ad5-bcec-4dbf-8200-211da749dee7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:10.123799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:10.124852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:10.125684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:10.132799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 169/341] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:10.132799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93fef-0bde-4eff-bc61-5767c34731d2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.132799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93fef-0bde-4eff-bc61-5767c34731d2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.132799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a93fef-0bde-4eff-bc61-5767c34731d2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.132799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 170/342] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:10.139070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93fef-0bde-4eff-bc61-5767c34731d2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.160832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.218789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 173/343] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 734 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:10.220593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.221141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.221628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.249567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:10.251096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:10.265504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.303622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a93fef-0bde-4eff-bc61-5767c34731d2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:10.372772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:10.373588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.373871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.374148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.374910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:10.375221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:10.376606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:10.385588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 174/344] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:10.386630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.402982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 171/345] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:10.408822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.532954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.569480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dcb2-7924-46c5-ac93-ca5791116244 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:10.585333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259157eb-4787-4ab5-8a66-baafa5d8d1cf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:10.629136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:10.630383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.630853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.631312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.632708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.634036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:10.635748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:10.638167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 175/346] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:10.640085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.640985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:10.646111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.646111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.646111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.736932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:10.738616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:10.786460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19c840-45c6-417a-b90d-334a688b4e0f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:10.836087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:10.838055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.838512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.838958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.853822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d944d53a-2b9c-486b-9893-9fc7e6cbe939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:10.864761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:10.865735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:10.866542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 176/347] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:10.867719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55c-c53a-4110-9264-a410b44ba538 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.867813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 172/348] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 07:07:10.868203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55c-c53a-4110-9264-a410b44ba538 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.868203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296eb55c-c53a-4110-9264-a410b44ba538 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.868331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.869325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 177/349] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:10.870401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d0f-0c14-4613-b8fe-2e455a1d422d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:10.870683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d0f-0c14-4613-b8fe-2e455a1d422d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:10.870960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8333d0f-0c14-4613-b8fe-2e455a1d422d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:10.872176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 178/350] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:10.877426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8333d0f-0c14-4613-b8fe-2e455a1d422d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:10.890941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.911786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:10.996946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc6f66-2e20-4598-ab49-c4e65208175a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.005288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8333d0f-0c14-4613-b8fe-2e455a1d422d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.044947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.047107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.047679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.048232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.049537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.050409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.050861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.051147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.052688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.055287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.055834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.059302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 179/351] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:11.059302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.059497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c65e3-4e7f-41cb-90f2-b014ea45d9c9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.059497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 173/352] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:10 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:11.060420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3192-cd8d-4b2c-85ed-e0ad55a56fa5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.061766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3192-cd8d-4b2c-85ed-e0ad55a56fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.061766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b3192-cd8d-4b2c-85ed-e0ad55a56fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.080429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d36b3192-cd8d-4b2c-85ed-e0ad55a56fa5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:11.081688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d36b3192-cd8d-4b2c-85ed-e0ad55a56fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:11.158828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.163177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 174/353] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:11.164729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.165190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.165645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.183018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:11.184498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:11.184887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41658dc0-ce65-43fc-b2c3-de9d7353d31e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.207435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.227942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.228619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.228903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.229386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.230288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:11.230767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.232268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.242844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 180/354] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:11.243688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.262932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 175/355] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:11.269228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.371199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0d12be-b190-4e79-9c43-14cf1a8097d8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.379032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de23db-084b-4b80-b8bb-200aad5d846e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.417474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.418340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.418469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.418605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.418885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.419070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.419356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.419638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.421192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:11.421511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.421608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.422970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.423083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2778e5a-3a45-4766-9cf6-176644a0c157 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.424835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 176/356] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:11.426162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb58a-1bca-4210-9fe7-c2865ac9ba4e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.426631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb58a-1bca-4210-9fe7-c2865ac9ba4e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.427062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eedb58a-1bca-4210-9fe7-c2865ac9ba4e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.428452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 177/357] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:11.429351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedb58a-1bca-4210-9fe7-c2865ac9ba4e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.433220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 181/358] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:11.434179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.439458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.471702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.578562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eedb58a-1bca-4210-9fe7-c2865ac9ba4e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.582982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86db6f6-195b-44ad-a0ed-19607d6d2d45 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.622078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.622794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.623037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.623233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.623381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.623739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.624024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.624301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.635704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:11.644045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:11.644965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:11.645918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 178/359] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:11.646587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.719106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:11.720688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:11.724663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.762148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:11.787299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38293856-ed91-4eca-ad87-e7f92458a053 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:11.833281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:11.834443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.834893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.835315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.843267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 182/360] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:11.849566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:11.849945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-94f11d5e-6dfc-476b-86ab-52a44c6fc1ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:11.860226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:11.861180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:11.861985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:11.862616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 179/361] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:11.863688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:11.863688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:11.863956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:11.882375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:11.883503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:11.976743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 180/362] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:11.977941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.000916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e2614-1330-437d-be17-f8bf3d34db2d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.003501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.044328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.045015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.045392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.045671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.047072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:12.047396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.048838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.061127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 183/363] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.061127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.084448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.112620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c95032-3c6a-47da-9d10-f89506d417b8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.174704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.175401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.175684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.176042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.176736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:12.177066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.178454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.186127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9650d-bf34-46a9-827d-3f480395c947 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.190278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 181/364] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.191160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.232411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.236513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.237558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.237851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.239402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.241957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.244434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 184/365] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.245339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.296294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.347096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9811-29b8-4fb4-b649-2cd9f169bf07 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.377762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc8ce1-e95c-4856-aba0-3e63b408b326 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.391367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.392072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.392305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.392584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.393375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:12.393686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.395050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.397352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.405810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 182/366] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.410863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.418914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.421519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.422040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.422546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.436389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:12.446316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:12.447344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:12.448410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:12.450956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 185/367] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:12.452185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.522395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84610c05-7b0f-4b6d-a814-3308bf3fffca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.558835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.559395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.559717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.560002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.560292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] PATH_INFO: `/v3/users/fc7c0e501764441fb89a370283e4e764` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.562135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] RBAC: Authorizing `identity:get_user(user_id=fc7c0e501764441fb89a370283e4e764)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.563572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.565384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 183/368] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/users/fc7c0e501764441fb89a370283e4e764 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.566167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.568467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c96b1-c0f4-492c-8d08-05f0923ef4e8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.608565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.609946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.610460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.610933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.612578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.614536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.617208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 186/369] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.618174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.637176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.673122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98857e95-1d11-4708-865b-d2b2c76d9371 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.711104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.711675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.711962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.712239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.737938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628beabf-1faf-49af-a32f-5ddfa5b4d1d7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.775616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.776820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.777324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.777835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.778927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:12.780328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.781939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.786096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.787550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.792000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 187/370] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.793060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.826206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.856961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:12.897140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 184/371] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:12.898055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:12.908083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29eb51c-dcf6-4b4e-86b0-220f63230f19 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:12.945629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:12.946343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:12.946629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:12.947057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:12.948290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] RBAC: Adding query filter params (role.id=96fd41f487c34e308bb87a78c02854de, user.id=fc7c0e501764441fb89a370283e4e764, scope.system=all) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:12.948695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:12.950163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:12.963769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 188/372] 10.222.0.27 () {56 vars in 1308 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/role_assignments?user.id=fc7c0e501764441fb89a370283e4e764&scope.system=all&role.id=96fd41f487c34e308bb87a78c02854de => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:12.964687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.007179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d795087-9fde-4237-a59b-d27131a74bf7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.044112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.044778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.045279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.045697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.046545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:13.046860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.048300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.055663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:13.056545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.068009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.093986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.096470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac88fb-1d7c-488c-885f-c50c552b5c04 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.147212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.148034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.148321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.148599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.174648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487ac8f-0d3d-499c-b596-1aa26b83c82d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.219823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.220628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.220912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.221292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.222528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.223974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.226360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 186/374] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:13.232009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.250727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.252236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.392178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 189/375] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:13.392852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.398788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.446771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.452792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7251732-b019-4a96-9514-6e5fb81e3463 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.501429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.503165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.503592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.504276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.507140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.509262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.511943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 187/376] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:13.517639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.531420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc21905-979a-4253-969a-db40a3bbf9c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.589701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.590744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.591031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.591305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] PATH_INFO: `/v3/projects/283d7870f6d24d52afa389aaf0d60d70` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.597487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] RBAC: Authorizing `identity:get_project(project_id=283d7870f6d24d52afa389aaf0d60d70)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.599208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.600993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 190/377] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/projects/283d7870f6d24d52afa389aaf0d60d70 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:13.613446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.699225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.713739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599e0dd-9ff0-4dff-98b9-8c8dc037bcbc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.749835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3392fd1-c6df-49b4-95bb-90512e03eabc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.774788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.775705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.775705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.775990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.776846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:13.777262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.778663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1323c64-b3b3-4371-823f-c35aaa4d7f30 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.789560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 188/378] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:13.792127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.793305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.793796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.794263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] PATH_INFO: `/v3/groups/0d13ecb083a84330a78fa93436260dee` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.803507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] RBAC: Authorizing `identity:get_group(group_id=0d13ecb083a84330a78fa93436260dee)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.803695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cad6-597f-48cc-954a-d897a279618c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.803967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cad6-597f-48cc-954a-d897a279618c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.804236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6cad6-597f-48cc-954a-d897a279618c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.805790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 189/379] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:13.806234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:13.808574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 191/380] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/groups/0d13ecb083a84330a78fa93436260dee => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:13.812550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.812845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.814324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.815450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:13.836454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:13.837726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:13.873719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.933078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cac3c-c6ff-425a-8486-06880e5a4362 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:13.937958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 190/381] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:13.957485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:13.994430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:13.995127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:13.995417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:13.995699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:13.996607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] RBAC: Adding query filter params (group.id=0d13ecb083a84330a78fa93436260dee, role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=283d7870f6d24d52afa389aaf0d60d70) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:13.996982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:13.998579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:14.007741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 192/382] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:13 2022] GET /identity/v3/role_assignments?group.id=0d13ecb083a84330a78fa93436260dee&scope.project.id=283d7870f6d24d52afa389aaf0d60d70&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:14.011135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:14.140149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754c2a1-a8a6-47d9-9335-4a6e4e3a4096 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:14.178694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:14.179502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.179786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.180070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.194338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:14.203447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:14.204329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:14.205144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 191/383] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:14.210731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:14.327850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5fdbf2-ba1b-43a7-af3d-abb0a80dbf1e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:14.370185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:14.370873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.371158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.371441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.372203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:14.372514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:14.374751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:14.384140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 193/384] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:14.389683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:14.420851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:14.510808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b814ce3c-ca9e-4586-a3ee-0113580bb4f6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:14.554051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:14.554920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.555203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.555484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.556703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:14.558178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:14.559913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 192/385] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:14 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:14.565960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:14.622108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:14.697290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302128f4-9725-42af-906e-b344d1bd94c7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:14.736655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:14.737562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.737848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.738125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.739365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:14.740820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5960e97-da11-4d56-81ed-a54f1b434a2e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:14.742571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 194/386] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:14 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:14.748404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:14.866376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:14.878727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982393f-f6e4-48e1-9d95-eb553180f69b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:14.921510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:14.922704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.923173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.923616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.923899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0948-f070-4711-a1bb-a21401770c85 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.924198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0948-f070-4711-a1bb-a21401770c85 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.924486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f0948-f070-4711-a1bb-a21401770c85 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.925907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 195/387] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:14.929094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, group_id=5abbd570e76c4054ab1a4a7582a5b7e2, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:14.930703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:14.931649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:14.931940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:14.932219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:14.952893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:14.954310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:15.035512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 196/388] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:15.055318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 193/389] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 12 07:07:14 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:15.063681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:15.114517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:15.198072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b24dd0-2d16-4cbd-9d22-52555e12b810 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:15.237005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:15.238159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.238633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.239043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.251489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:15.260216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:15.261380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:15.262406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:15.264811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 197/390] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:15.270983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:15.381532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70196c-dde0-4beb-b3ec-c5333681d56f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:15.417555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:15.418492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.418948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.419363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.421036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:15.421491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:15.423023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:15.432245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 194/391] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:15.438046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:15.570929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:15.575674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f62a89d-30b8-4820-85e3-f818b0a127c9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:15.617308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:15.618447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.618874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.619287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.620665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:15.622354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:15.625393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 198/392] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:15 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:15.630986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:15.644757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:15.736380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe06d6-5fee-4451-abd8-5eb5f34361cc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:15.770438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:15.771715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.772759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.773222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.774546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:15.776237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6e019-e193-4a9e-ab15-55084915568d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:15.778412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 195/393] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:15 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:15.784853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:15.896793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f441a-8ac0-4dc3-b376-a6b411753209 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:15.940607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:15.941531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.941819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.942094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.944395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] RBAC: Authorizing `identity:create_grant(project_id=b531ae1ba1af48998fafc62a9441a3d2, group_id=5abbd570e76c4054ab1a4a7582a5b7e2, role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:15.945863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:15.983378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46d3c-0b26-488f-a4c3-2a2d8122be42 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.984006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46d3c-0b26-488f-a4c3-2a2d8122be42 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.984460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e46d3c-0b26-488f-a4c3-2a2d8122be42 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:15.986437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 196/394] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:15.992086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:15.992599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:15.993079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.011782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:16.013512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:16.020758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 199/395] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 12 07:07:15 2022] PUT /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/da841affa12f4aa58bdf9bf9f469204c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:16.110470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 197/396] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:16.133990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.179105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:16.289576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa48ae-8a0e-4fff-94b7-d1327bffd094 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:16.329142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:16.329993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.330275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.330544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.341144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:16.348875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:16.349791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:16.350580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:16.354415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 200/397] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:16.361103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.379991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:16.487606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc74a4-e8ea-4946-a758-413e205bc992 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:16.525156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:16.526204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.526696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.527172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.528121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:16.528620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:16.530494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46952f96-5639-4746-873b-a468eb906cd5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:16.539837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 198/398] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:16.545594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.590771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95735f-4276-4779-b101-df422dcc3476 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.591090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95735f-4276-4779-b101-df422dcc3476 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.591343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95735f-4276-4779-b101-df422dcc3476 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.593907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 199/399] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:16.597330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e23d-2d26-4ca0-a024-5264e335937c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.597622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e23d-2d26-4ca0-a024-5264e335937c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.597903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e23d-2d26-4ca0-a024-5264e335937c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.599928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 200/400] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:16.601404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc4b2-73bf-43cf-be76-035e141de3d0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.601698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc4b2-73bf-43cf-be76-035e141de3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.602118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc4b2-73bf-43cf-be76-035e141de3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.625270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-537dc4b2-73bf-43cf-be76-035e141de3d0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:16.627175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-537dc4b2-73bf-43cf-be76-035e141de3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:16.672232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:16.685099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0e8d1-fe73-4ac9-8b04-b6a572453eac None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:16.714594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:16.720947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 201/401] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:16.722287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.722575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.722847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.731226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:16.731873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.732153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.732984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.735360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:16.736641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:16.742781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 201/402] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:16.744952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.749780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:16.751355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:16.833208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 202/403] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:16.834246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.878394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186b9ef-4d5c-4bab-8901-7171f63015ef None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:16.925707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:16.926641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:16.926924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:16.927324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:16.940729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:16.957541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:16.958505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:16.959304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:16.959913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 202/404] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:16.961058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:16.967050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d137f904-a73b-4515-a15e-8617be414a16 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:16.986713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.013648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.013648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.013648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.013648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.014113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.014611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.016737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.019137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 203/405] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.020130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.092590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117b4e8-1f44-4b1c-a596-102430db2ba3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.131782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.132698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.132986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.133379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.137081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610794c-df2f-48df-bf22-af3c5caa4c66 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.144563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:17.152849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:17.153861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:17.154862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:17.159168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 203/406] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:17.160071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.182401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.183387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.183911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.184904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.186267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:17.186773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.189258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.200919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 204/407] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.202778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.253375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.274062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.283300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af670c35-eed9-4a7d-8a5b-d6f0eb86a456 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.316735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d3d0-0893-452e-82b4-28cd48791506 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.326327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.327529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.328387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.328860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.331581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, group_id=5abbd570e76c4054ab1a4a7582a5b7e2, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.333928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.354716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.355438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.355722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.355995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.356831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:17.357172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.358956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.372002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 205/408] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.372002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.409051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 204/409] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 12 07:07:17 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:17.409051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.573655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee4e2fa-5ac1-44cb-b169-83f2e7810b2b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.612332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a1f61-62cf-4050-bd4d-37d19acb60f6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.620210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.633129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.634299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.634872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.635303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.636705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.639995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.643046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 206/410] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.648621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.662729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.663891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.664377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.664821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] PATH_INFO: `/v3/groups/0d13ecb083a84330a78fa93436260dee` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.666274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] RBAC: Authorizing `identity:get_group(group_id=0d13ecb083a84330a78fa93436260dee)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.667871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.670426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 205/411] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/groups/0d13ecb083a84330a78fa93436260dee => generated 229 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.676937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.683183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.774438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6d8e-5892-4ee8-8478-9af0f1da0aea None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.800170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f22c1-84f3-4cc8-8bc9-3e47d0333d3b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.819540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.820761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.821282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.821753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.824417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.827000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076778d1-392c-4ffe-b831-55820af48d64 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.834629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 207/412] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.834629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6f0c-be51-4d59-82ff-e0607f8b44e1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.834845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6f0c-be51-4d59-82ff-e0607f8b44e1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.835060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d6f0c-be51-4d59-82ff-e0607f8b44e1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.836892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 208/413] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:17.837430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6f0c-be51-4d59-82ff-e0607f8b44e1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.854841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:17.855977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.856262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.856539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] PATH_INFO: `/v3/projects/283d7870f6d24d52afa389aaf0d60d70` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.858300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] RBAC: Authorizing `identity:get_project(project_id=283d7870f6d24d52afa389aaf0d60d70)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:17.860278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89e219-1455-4022-af43-d113b8a9f871 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:17.866813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 206/414] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:17 2022] GET /identity/v3/projects/283d7870f6d24d52afa389aaf0d60d70 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:17.866813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:17.866813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:17.866813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:17.886661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:17.887996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:17.916126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:17.966472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d6f0c-be51-4d59-82ff-e0607f8b44e1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:17.969619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 207/415] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:17.970791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:17.973601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:18.009693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.011276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.011276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.011276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.013509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] RBAC: Authorizing `identity:create_grant(project_id=58e3f64c75f2405f84ed6492b1c998dc, group_id=5abbd570e76c4054ab1a4a7582a5b7e2, role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:18.015539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:18.082339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb4d465-a6c9-4300-a38a-d9a91d1c2925 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:18.086706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 209/416] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 12 07:07:17 2022] PUT /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc/groups/5abbd570e76c4054ab1a4a7582a5b7e2/roles/da841affa12f4aa58bdf9bf9f469204c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:18.087546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.151424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.152549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.152836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.153136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] PATH_INFO: `/v3/projects/283d7870f6d24d52afa389aaf0d60d70/groups/0d13ecb083a84330a78fa93436260dee/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.159255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] RBAC: Authorizing `identity:create_grant(project_id=283d7870f6d24d52afa389aaf0d60d70, group_id=0d13ecb083a84330a78fa93436260dee, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:18.161566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:18.247469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea33d91-f27f-4fd4-bb75-55574a3b0b8f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:18.261163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 208/417] 10.222.0.27 () {58 vars in 1442 bytes} [Tue Jul 12 07:07:17 2022] PUT /identity/v3/projects/283d7870f6d24d52afa389aaf0d60d70/groups/0d13ecb083a84330a78fa93436260dee/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:18.276013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:18.306522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.307350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.307634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.308029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.322047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bdd0b929-6e24-4d59-9fb8-5b87ba0bcfe8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:18.330730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:18.331706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:18.332532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 210/418] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:18.338118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.413191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:18.455105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3023688-0d26-45ce-a6cd-57361d975a62 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:18.492151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.492828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.493156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.493584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.495063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e472fc-a48e-4160-8dce-064b9a963757 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.495257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:18.495407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e472fc-a48e-4160-8dce-064b9a963757 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.495564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:18.495650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e472fc-a48e-4160-8dce-064b9a963757 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.496933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:18.497761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 211/419] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:07:18.503560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.503841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.504117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.508097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 209/420] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:18.513502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.523308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:18.524661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:18.606766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 212/421] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:18.622817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55efe8-1881-4623-b55c-5c0d698e1c90 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:18.628742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.648117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:18.678657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.679332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.679612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.679891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.738179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6974b7-726e-4447-ab45-94ca118725e3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:18.748288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:18.774896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:18.775739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:18.776010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:18.776301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:18.790648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:18.799999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:18.801772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:18.807805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:18.808741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:18.809562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:18.816239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 213/422] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:18.822133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.919720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 210/423] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 07:07:18.930076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:18.965329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:19.021156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b155d41-7a14-4950-a12d-7f9bc69d3e0d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.077088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.078008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.078440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.078861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.079752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:19.080234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.082107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.093828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8987dd62-af9e-4e0f-ae20-7274c59ca0f3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.103641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 214/424] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:19.110120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:19.133075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.133075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.133075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.133075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.133677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.134829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.140229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 211/425] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:18 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:19.146504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:19.175542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:19.298328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112f2dc-0538-46d4-a754-8846427424e1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.307591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:19.322615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c4fd6-8ba6-4f8e-8dc3-9a5c5371d6c4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.355903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.356553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.356831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.357134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.386545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.387402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.387688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.387961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.391747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.393202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.396102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:19 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:19.401820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:19.482736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.484073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.549470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:19.575896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bab8da-b596-4f48-901d-deed9e34d2c5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.615269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.615928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.616205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.616474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.617355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:19.617664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.621059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.627373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 213/427] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:19 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 611 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:19.686121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 215/428] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:19.692257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:19.738559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:19.836993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f12f05-c7f0-4cd0-950f-14ff10c0498d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:19.887692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:19.888623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.888913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.889200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] PATH_INFO: `/v3/projects/b531ae1ba1af48998fafc62a9441a3d2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.890612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] RBAC: Authorizing `identity:get_project(project_id=b531ae1ba1af48998fafc62a9441a3d2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:19.892059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3379-b91b-4d3a-baee-39ce74394242 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:19.893947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 214/429] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:19 2022] GET /identity/v3/projects/b531ae1ba1af48998fafc62a9441a3d2 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:19.899540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:19.923931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c528e9-fdf9-4be9-90ee-ba2997862bae None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.924216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c528e9-fdf9-4be9-90ee-ba2997862bae None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.924497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c528e9-fdf9-4be9-90ee-ba2997862bae None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.926690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 215/430] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:19.935018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:19.935292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:19.935807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:19.959945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:19.961665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:20.053224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 216/431] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:20.068660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f4697-6513-42a4-bc48-b265f0a34b9f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.074694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.104563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.109886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.116996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.119045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.119482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.119906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.121323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:20.123072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:20.126641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 216/432] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:19 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:20.132262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.188039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb7ac1-3b3b-433d-83a4-53562ba93b2c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.225373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.226182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.226574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.226747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.238603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:20.246502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:20.247391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 07:07:20.248912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:20.252702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 217/433] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:20.254188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.265476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b73e5-3d21-4bd6-9cdd-c5501c8c05d5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.316839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.318273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.318701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.319139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.320244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=b531ae1ba1af48998fafc62a9441a3d2) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:20.320899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:20.322555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:20.330678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 217/434] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=b531ae1ba1af48998fafc62a9441a3d2&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:20.343415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.364077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af6473-a02f-48aa-a648-a72e85c63c91 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.403897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.405300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.405642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.405941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.406713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] RBAC: Adding query filter params (name=member) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:20.407020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:20.408437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892e2920-c0ac-4140-b140-72ce5f910751 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:20.422433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 218/435] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:20.425531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.501093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.547026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd88f7-34ed-4057-a3e1-ce54c91935c0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.586667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.587306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.587591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.587867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.664939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:20.666508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:20.733992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.760012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7012-551a-48d4-a3b2-a6624ff7adfd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.760322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7012-551a-48d4-a3b2-a6624ff7adfd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.760574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b7012-551a-48d4-a3b2-a6624ff7adfd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.764146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 219/436] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:20.770638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c781-c1ee-4f3a-b653-bc66c9f975fc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.770922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c781-c1ee-4f3a-b653-bc66c9f975fc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.771196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc6c781-c1ee-4f3a-b653-bc66c9f975fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.782476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 218/437] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:20.788759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1dc6c781-c1ee-4f3a-b653-bc66c9f975fc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:20.788909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.790306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1dc6c781-c1ee-4f3a-b653-bc66c9f975fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:20.885123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 220/438] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:20.885123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082853-8fb4-428e-b551-dcd2bc7aef0e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.885123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082853-8fb4-428e-b551-dcd2bc7aef0e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.885123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd082853-8fb4-428e-b551-dcd2bc7aef0e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.885123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 221/439] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:20.890109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.891437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.891716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.909782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345395bb-d2b0-4634-948d-13693c8bd6fe None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:20.911749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:20.913006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:20.944179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:20.945062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:20.945351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:20.945629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:20.946811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:20.948506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:20.955155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 219/440] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:20.955155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.983688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 222/441] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:20.984545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:20.984966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:20.987504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.063657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31101c03-96c8-4d1a-8281-c949d7bfa78b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.083477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1b752-070e-4df6-83ac-58379f8d69cd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.096509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.097333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.097609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.097880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.108072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:21.115912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:21.116936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:21.117802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:21.118636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.118636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.118794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 220/442] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:21.118861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.118861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.118986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.119477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.121012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.123393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 223/443] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:20 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:21.123997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.192205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.210417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.220018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04aaaf3-a64b-4f85-b0cc-ade31c583a4d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.222269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f8534-78dc-4794-8dcb-0197b68a5917 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.254960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.255758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.256041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.256314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.256559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.257253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.257538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.257814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.258561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:21.258874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.260231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.266537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:21.268326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 224/444] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:21.269134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:21.274516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:21.275561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:21.276364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 221/445] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:21.277009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.368840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728a9cd-e345-438f-8fe0-3f03d19f9fe6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.376741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd7d54-7946-4c0e-8a3f-aa0a6274b7db None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.402576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.403220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.403510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.403790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.404654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=e5ea235ccd4840438ecdecc166e6794e, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:21.404965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.406432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.408190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.409144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.409766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.410044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.410314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.412645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 225/446] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=e5ea235ccd4840438ecdecc166e6794e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:21.413441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.438401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.497059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.498642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.532366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce84330-f882-4be3-afdf-35c60f977137 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.572316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.572517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.573048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.575139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.575139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:21.575139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.575740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.585211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 226/447] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:21.591135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.615464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 222/448] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:21.621309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.670360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.678159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.719251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6239fe-b5b4-49f9-a644-88192b6563c7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.737210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c85f7f-9019-4ff4-a280-34c56b243830 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.765860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.766440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.766728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.767012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.774671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.775526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.775808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.776081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] PATH_INFO: `/v3/projects/283d7870f6d24d52afa389aaf0d60d70` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.777307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] RBAC: Authorizing `identity:get_project(project_id=283d7870f6d24d52afa389aaf0d60d70)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.778724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.780788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 223/449] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/projects/283d7870f6d24d52afa389aaf0d60d70 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:21.786001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.834250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.835692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.885515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e0b18-1998-4cb0-8612-9b45b8bf3d61 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:21.890950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.902598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:21.919281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:21.920259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:21.920540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:21.920814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] PATH_INFO: `/v3/groups/0d13ecb083a84330a78fa93436260dee` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:21.922038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] RBAC: Authorizing `identity:get_group(group_id=0d13ecb083a84330a78fa93436260dee)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:21.923460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:21.925094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 224/450] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/groups/0d13ecb083a84330a78fa93436260dee => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:21.932379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 227/451] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:21.959069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:21.959224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:22.038223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04a10d-737a-464a-a7af-723fe26792eb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:22.040605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61920c7-a00e-4f95-9ca5-b172035e71f7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:22.071932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:22.073052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:22.073344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:22.073618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] PATH_INFO: `/v3/projects/58e3f64c75f2405f84ed6492b1c998dc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:22.074568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:22.074779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] RBAC: Authorizing `identity:get_project(project_id=58e3f64c75f2405f84ed6492b1c998dc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:22.075214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:22.075498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:22.075801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:22.076290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:22.076755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] RBAC: Adding query filter params (group.id=0d13ecb083a84330a78fa93436260dee, role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=283d7870f6d24d52afa389aaf0d60d70) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:22.077089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:22.078020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 228/452] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/projects/58e3f64c75f2405f84ed6492b1c998dc => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:22.078581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:22.083401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:22.097053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 225/453] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:21 2022] GET /identity/v3/role_assignments?group.id=0d13ecb083a84330a78fa93436260dee&scope.project.id=283d7870f6d24d52afa389aaf0d60d70&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:22.112443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:22.189417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4326e2-b479-4665-87d3-c4dc1329eb0f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:22.224273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:22.225159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:22.225438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:22.225707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] PATH_INFO: `/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:22.226886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] RBAC: Authorizing `identity:get_group(group_id=5abbd570e76c4054ab1a4a7582a5b7e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:22.228317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda9a18-6689-46a7-b1b5-12b5d862d906 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:22.230152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 229/454] 10.222.0.27 () {56 vars in 1180 bytes} [Tue Jul 12 07:07:22 2022] GET /identity/v3/groups/5abbd570e76c4054ab1a4a7582a5b7e2 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:22.236303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:22.289181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:22.336763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc0ad9-1421-413a-87d3-ccac90474610 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:22.369230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:22.369875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:22.370158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:22.370431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:22.371260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] RBAC: Adding query filter params (group.id=5abbd570e76c4054ab1a4a7582a5b7e2, role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=58e3f64c75f2405f84ed6492b1c998dc) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:22.371573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:22.373056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39706f99-0afe-44cf-842f-5a7c0c5b1b39 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:22.378668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 226/455] 10.222.0.27 () {56 vars in 1376 bytes} [Tue Jul 12 07:07:22 2022] GET /identity/v3/role_assignments?group.id=5abbd570e76c4054ab1a4a7582a5b7e2&scope.project.id=58e3f64c75f2405f84ed6492b1c998dc&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:24.981996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54104-655d-4cc9-9ab0-915713338010 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:24.983076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54104-655d-4cc9-9ab0-915713338010 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:24.983561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b54104-655d-4cc9-9ab0-915713338010 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:24.985448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 230/456] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:24.990400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84daca-23d0-4c19-9f35-33e17545ec3f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:24.991234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84daca-23d0-4c19-9f35-33e17545ec3f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:24.991715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84daca-23d0-4c19-9f35-33e17545ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.017468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2e84daca-23d0-4c19-9f35-33e17545ec3f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:25.018995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2e84daca-23d0-4c19-9f35-33e17545ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:25.119728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 227/457] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:25.139556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9884-12bb-451b-9f5d-e3ba70d57df7 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.140194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9884-12bb-451b-9f5d-e3ba70d57df7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.140678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b9884-12bb-451b-9f5d-e3ba70d57df7 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.142441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 231/458] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:25.148370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.148370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.148370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.152954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b9884-12bb-451b-9f5d-e3ba70d57df7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.174307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:25.176370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:25.261476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:25.264400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:25.265935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b9884-12bb-451b-9f5d-e3ba70d57df7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:25.304962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:25.306072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.306869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.307846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.309409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 228/459] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:25.328480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:25.330328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:25.364909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:25.365904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:25.366778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:25.366778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:25.366778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:25.366778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:25.368757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 232/460] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:25.374838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.384609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.531906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361d377-07f3-49f3-950b-da1c9c5b7cc6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:25.548312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ca7cb-2071-4a1f-a082-a152323dd93c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:25.574560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:25.575599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.576304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.576901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.577831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:25.578145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:25.579525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636cf84-4846-48db-b321-5de553af9334 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:25.585085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:25.585882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.586169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.586443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.592812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 229/461] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:25.593210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad5ef-c69e-4111-8d56-057bd4534571 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.593638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad5ef-c69e-4111-8d56-057bd4534571 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.594065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ad5ef-c69e-4111-8d56-057bd4534571 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.595432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 230/462] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:25.596620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64785-a5a4-41ef-b8ca-3026303bd421 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.597430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64785-a5a4-41ef-b8ca-3026303bd421 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.597715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64785-a5a4-41ef-b8ca-3026303bd421 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.599087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 231/463] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:25.599841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64785-a5a4-41ef-b8ca-3026303bd421 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.603331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:25.604806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:25.614741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-96780129-07e2-41e0-9821-321f6beddd3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:25.624685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:25.625578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:25.626432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:25.626432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:25.626432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:25.626432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:25.626432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 233/464] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:25.627304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84b1c-b52b-484e-a3f3-b054877531d2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.627403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84b1c-b52b-484e-a3f3-b054877531d2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.627682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da84b1c-b52b-484e-a3f3-b054877531d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.644095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:25.644258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6da84b1c-b52b-484e-a3f3-b054877531d2 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:25.645390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6da84b1c-b52b-484e-a3f3-b054877531d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:25.715625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64785-a5a4-41ef-b8ca-3026303bd421 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:25.719425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 234/465] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:25.720822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.721140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.721421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.737588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:25.739050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:25.762898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:25.764153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.764487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.764713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.765455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:25.766879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:25.808915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 235/466] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:25.809714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.868450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:25.885322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 232/467] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:25 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:25.886430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:25.926096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7812b-5282-41dc-82b5-df9d3b997ec2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:25.967912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:25.968988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:25.969301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:25.969573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:25.970314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:25.970618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:25.972054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:25.993396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 236/468] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:25.998268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.019421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.031873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877c32-019a-46f4-bccb-431f0ed63f27 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.072991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.074238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.074781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.075225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.087991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.089565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:26.109445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:26.110329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 233/469] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:26.111877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.118444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e391b-7e44-4ec7-ac16-300d4655199b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.147923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.165815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.167455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.167847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.168130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.181171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.183034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:26.203893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:26.204815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:26.206091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:26.206091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:26.206091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:26.206091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:26.206091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 237/470] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:26.207113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.245394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778eebd8-a6cf-477f-92f0-29d525ff297c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.293015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.294223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.295779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.296216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.297104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.298707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.332998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d413544-5f9b-4bb2-bddf-44c7bb6800f9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.365489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.366156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.366441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.366717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.367437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:26.367743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.369150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.385989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 238/471] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:26.385989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.417105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.427289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.442522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 234/472] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:26 2022] POST /identity/v3/users => generated 248 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:26.442522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.524376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7948cb93-ebd0-4e65-a890-00ca8a15ce12 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.576662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.578052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.578564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.579307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.581001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:26.581363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.583957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e51d0a-8f25-4857-9d4a-cd82d482f7f3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.591102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4a56a-2fd6-4f0e-a0be-029637cc51b8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.599624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 239/473] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:26.601308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba508a57-384b-4911-95d9-7b9cb37b0668 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.601308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba508a57-384b-4911-95d9-7b9cb37b0668 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.601569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba508a57-384b-4911-95d9-7b9cb37b0668 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.607685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 240/474] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:26.608396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba508a57-384b-4911-95d9-7b9cb37b0668 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:26.644071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.644753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.645057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.645403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.646126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.647604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9294c5-5cb5-4348-9bbe-1945831ae0ec None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.729210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.741879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba508a57-384b-4911-95d9-7b9cb37b0668 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:26.769058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 235/475] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:26 2022] POST /identity/v3/users => generated 248 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:26.769058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.769058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.769058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.804916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:26.810333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:26.831281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:26.831977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:26.832263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:26.832538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:26.833302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:26.837176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:26.922338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:26.933319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 241/476] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:26 2022] POST /identity/v3/users => generated 249 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:26.965600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 236/477] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:26.996421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:27.134733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5f8-bf0c-4bea-bab9-0fa1b2f7adb3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:27.173963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:27.174659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:27.174940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:27.175212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:27.175981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:27.177583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:27.211054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.sql.core [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 07:07:27.211054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 07:07:27.211054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [parameters: {'id': 'ac6bcf739ed54815b875c4e35f489833', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 07:07:27.211054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:07:27.230113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:07:27.231090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application yield resource Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise self.value Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application session.commit() Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 07:07:27.232077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.flush() Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application compat.raise_( Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 07:07:27.233426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:07:27.234951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:07:27.235870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [parameters: {'id': 'ac6bcf739ed54815b875c4e35f489833', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:27.236635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 07:07:27.240622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:27.242711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 242/478] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 12 07:07:26 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:27.242845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:27.370458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde4b19-5892-45a3-b5f6-b2469db88fa6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:27.420192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:27.421076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:27.421436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:27.421717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:27.437969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3ffad879-7d15-4872-b174-3380e97b8ede None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:27.446378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:27.447510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:27.448748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 237/479] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:27.455957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:27.484777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:27.619937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac755548-d4e0-46fc-a949-742c2f3111df None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:27.666890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:27.667795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:27.668247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:27.668671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:27.670161 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:27.670686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:27.672194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8c443b-d337-4bb2-b30a-be0312ddfc49 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:27.686081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 243/480] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:28.173176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387e4f-f2aa-499d-a755-fd5d48d22a4f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.173530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387e4f-f2aa-499d-a755-fd5d48d22a4f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.173736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1387e4f-f2aa-499d-a755-fd5d48d22a4f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.175468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 238/481] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:28.181613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.182035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.182214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.200565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:28.202683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:28.286624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 244/482] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:28.322531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387e4f-f2aa-499d-a755-fd5d48d22a4f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:28.377307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:28.434811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1387e4f-f2aa-499d-a755-fd5d48d22a4f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:28.470780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:28.471942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.472416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.472878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.484117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:28.492065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:28.492932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:28.493854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:28.501219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 239/483] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:28.506135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:28.509343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:28.635956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629cfefb-94b7-44ff-824a-fb26f039560d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:28.671909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:28.672589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.672879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.673186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.673946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:28.674251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:28.675681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:28.684592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 245/484] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:28.690727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:28.837331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483a636-475a-48d9-ab3d-1a65c3c828f1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:28.839700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:28.887637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:28.888998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.889436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.889716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.900521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:28.902008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ffefed8f-9cca-4e52-a5ce-ea66f6ee94f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:28.919109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:28.920612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:28.921507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:28.921507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:28.921507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:28.921507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:28.921507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 240/485] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:28.929079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:28.960532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bd78-0bb3-4c2d-b888-dd7527e28671 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.961133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bd78-0bb3-4c2d-b888-dd7527e28671 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.961611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bd78-0bb3-4c2d-b888-dd7527e28671 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:28.963400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 241/486] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:28.969404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:28.969943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:28.970410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.001850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:29.003026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:29.068124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.117564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 242/487] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:29.131142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4078786-0e48-4c88-a7fb-8886d2eae284 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.139732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.209741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.210488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.210670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.210953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.211747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:29.212051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:29.213510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:29.235794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 246/488] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:29.246345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.249059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.264447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8f343-699f-4008-b336-89a0c959a808 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.303665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.304465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.304745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.305038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.335869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:29.345885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:29.346795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:29.347586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:29.355013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 243/489] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:29.364614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.405445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686afdc-61e9-4e23-a283-65bba7277243 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.446799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.468157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.469459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.469956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.470433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.481941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:29.485304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:29.504812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:29.505854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:29.506768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:29.509600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 247/490] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:29.515632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.552197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c635c2b-e5bc-4ae2-bc4c-7fde1a161d7c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.598771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.599454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.599834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.600005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.600940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:29.601254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:29.603160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b5dac-4864-4de3-b568-d54f28c20c40 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:29.613803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 244/491] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:29.618783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5854-03bd-4f79-99a1-db635d40db31 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.618783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5854-03bd-4f79-99a1-db635d40db31 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.618783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e5854-03bd-4f79-99a1-db635d40db31 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.618783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 245/492] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:29.621415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e5854-03bd-4f79-99a1-db635d40db31 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.638149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.649732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a012111-f239-4166-8082-6e172447e9c5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.688122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.689274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.689764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.690298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.691386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:29.691897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:29.693597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc707f-d917-49cf-a025-fe19b94cde4e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:29.745110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 248/493] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:29.746755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0499-4d36-418e-b1fc-c296fbf8a668 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.747318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0499-4d36-418e-b1fc-c296fbf8a668 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.748300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e0499-4d36-418e-b1fc-c296fbf8a668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.754480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e5854-03bd-4f79-99a1-db635d40db31 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.766302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9a8e0499-4d36-418e-b1fc-c296fbf8a668 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:29.767462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9a8e0499-4d36-418e-b1fc-c296fbf8a668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:29.790388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.791177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.791457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.791730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.802656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:29.804071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:29.812826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:29.823087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:29.823937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:29.824797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:29.824797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:29.824797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:29.824797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:29.824797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 246/494] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:29.825077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.845116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 249/495] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:29.847155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b3ade-0660-46da-97b6-6eecbf6f516f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.847618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b3ade-0660-46da-97b6-6eecbf6f516f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.848060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625b3ade-0660-46da-97b6-6eecbf6f516f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.849550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 250/496] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:29.855066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b3ade-0660-46da-97b6-6eecbf6f516f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:29.894610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:29.937197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3d7189-5df4-48e9-a52e-0c6d67492997 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:29.972579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:29.973618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:29.973901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:29.974177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:29.980554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625b3ade-0660-46da-97b6-6eecbf6f516f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.018845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.019509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.020103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.020378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.021419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:30.021722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.023621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a7f33-9cae-4b6a-8a03-22346f3bc987 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.042704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 251/497] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:30.042704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.042704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.042704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.046975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.048426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.058414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:30.059599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:30.089328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.109739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.142319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 252/498] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:30.142319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.152163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 247/499] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:30.154432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.254300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa57ee-f6ab-4e85-ac33-842de1e076f4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.258372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0e15e-f6f7-4301-92d0-2f4af359fe82 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.289775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.290572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.290850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.291122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.292727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.293544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.293822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.294091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.301258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.302695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.303121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:30.312065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:30.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:30.313749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:30.319687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 253/500] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:30.319687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:30.319875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:30.320703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 248/501] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:30.322246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.347230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.348250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.425912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646fa21-eba1-4c4e-8a21-c7e0a25f6718 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.435766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9915c68-7358-4987-b75c-877dc424a3eb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.460133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.460918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.461224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.461499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.470475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.471269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.471554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.471829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.471965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.473447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.481843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:30.489687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:30.490690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:30.491505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:30.492100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:30.492836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:30.493687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:30.493687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:30.493687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:30.493687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:30.493900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 249/502] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:30.493900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.496442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 254/503] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:30.497239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.571709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.576385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.594949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf34d0-b25d-439d-9b72-9987a4041b47 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.595108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d92903-1530-452a-8002-ba70d5ce885e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.628925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.629306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.629618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.629901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.629988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.630176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.630262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.630494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.630920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:30.631226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.631317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:30.631603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.632610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427d31b-e85d-4df4-94f4-22c7b70fb4bd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.633008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.640873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 250/504] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:30.642130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3418a1-a2e3-4859-88c4-97dfc5b767a2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.642416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3418a1-a2e3-4859-88c4-97dfc5b767a2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.642691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3418a1-a2e3-4859-88c4-97dfc5b767a2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.644001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 251/505] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:30.644753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3418a1-a2e3-4859-88c4-97dfc5b767a2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.656446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 255/506] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:30.657903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.745861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3418a1-a2e3-4859-88c4-97dfc5b767a2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.756396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434d1bf-4d2f-46f7-a6ac-11c906a08684 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.778036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.778697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.779510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.779783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.780533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:30.780839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.782247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.790040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 252/507] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:30.790817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.791177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.791803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.792094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.792372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.793137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:30.793437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.795514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc950d-1892-4a87-b87b-d3c7110921f4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.796443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.797166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:30.807469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 256/508] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:30.810483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.810854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.811162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.827159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:30.828329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:30.890815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273cc72-adfc-4792-8f61-8cd85ccdf6fb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:30.893733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 257/509] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:30.897006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:30.926105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181922-c810-4510-9da4-08aa48732125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:30.926894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181922-c810-4510-9da4-08aa48732125 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:30.927173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181922-c810-4510-9da4-08aa48732125 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:30.927445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181922-c810-4510-9da4-08aa48732125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:30.938448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84181922-c810-4510-9da4-08aa48732125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:30.939874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84181922-c810-4510-9da4-08aa48732125 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-84181922-c810-4510-9da4-08aa48732125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:30.957484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:30.958404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:30.959442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:30.959442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:30.959442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:30.959442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:30.959442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 253/510] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:30.959863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181922-c810-4510-9da4-08aa48732125 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.005463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a0791-c84a-48c4-bd01-7b7c5088812a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.018147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.030157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.040166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.040805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.041114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.041388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.059335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181922-c810-4510-9da4-08aa48732125 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.093335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.094054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.094344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.094624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.105098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.106537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.106758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.108312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:31.123898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.124738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.125637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:31.125637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:31.125637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.125637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:31.125637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 254/511] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.125893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.211336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 258/512] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:31.212373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.223274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e9e36-63ed-4f5f-ac59-e8e39e236e20 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.232521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.236424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.257544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.258338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.258623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.258902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.265600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.267117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:31.282352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.283321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:31.284152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:31.284554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 255/513] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.285332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.310056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c8a9e-8aac-43eb-8a7e-1f9efb44274c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.343614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.344336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.344607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.344879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.355080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.356604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:31.374644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.375514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.376363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:31.376363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:31.376363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.376363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:31.376363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 259/514] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.376632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.385960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca17cd-d55f-4c1e-9f70-a85795781609 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.420947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.421638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.421925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.422203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.422929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:31.423238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.424599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.435785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 256/515] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:31.436652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.452201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.465124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.474772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a55038-6ce3-4062-9e1d-50141a48fb20 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.509551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.510215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.510501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.510777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.511507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:31.511863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.513289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.524879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 260/516] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:31.525707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.539141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5e171-1f17-4700-a369-b615cbb6de2b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.572636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.573702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.573986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.574271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.584859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.586348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:31.603849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.604709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.605604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:31.605604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:31.605604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:31.605604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:31.605604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 257/517] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.606882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.623679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f748df-ad8f-4d7a-b413-df0af05df8ea None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.657722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.658379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.658660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.658933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.659734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:31.660019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.661586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.665790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.679972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 261/518] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:31.680778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.691787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.710887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af681996-06e1-4ffd-be10-854006f998ea None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.743822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.744504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.744785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.745081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.745797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:31.746099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.747452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.760876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 258/519] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:31.761708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.780618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d506c82-fb33-4157-aaf8-c62a53797799 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.814224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.815118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.815469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.815812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.823082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.824532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:31.840812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.842025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:31.842939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 262/520] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.843499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.861140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43334b7-de38-4ccc-9046-fa15941542e9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.894822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.895620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.895904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.896182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.898788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.903153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.904616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:31.907643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:31.920141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:31.927857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 259/521] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:31.928941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:31.944868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0bfb4c-cbdb-4a9b-9c77-95785c6f549e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:31.981870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:31.983045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:31.983331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:31.983608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:31.984342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:31.984650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:31.986073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.002631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 263/522] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:32.002631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.026369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ccdc1-4188-4a93-ba16-6a4f9c524ef7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.061548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.062203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.062490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.062769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.063605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:32.063920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.065382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.070793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 260/523] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:31 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:32.071575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.107710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca898a-4082-445f-b873-cb6e188a453d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.129908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.144421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.149003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.150089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.150386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.150665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.151407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.152883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.184312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acdf0ed-28e4-4c50-9ea9-1cd36e91a4fd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.221336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.222015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.222304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.222585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.223435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:32.223754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.225220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.245722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 264/524] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:31 2022] POST /identity/v3/users => generated 247 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:32.246671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.270112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 261/525] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:32.271286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.395250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f283-021b-4b9c-827a-0ab3be08808a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.401495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f596d-18d5-471b-9c01-fd3ee4f565eb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.429400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.443686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.444117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.445064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.445064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.445222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.445713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:32.445820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.446083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.446172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.446365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.448151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.455960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.457784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.470122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 265/526] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:32.471065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:32.474631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:32.475480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:32.476313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 262/527] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:32.481255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.507457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.594797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968365c6-bce4-4383-8506-036ea1636eaa None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.594997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892f062-4c32-46d9-97fb-371349151814 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.636233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.637186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.637607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.638019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.640476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.641286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.641680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.642303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.698139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.722986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.724565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.733260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.734828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:32.769225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.841586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 266/528] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:32.842286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.858479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 263/529] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:32.859568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:32.950310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a332cc-11e6-4b2c-a60d-00aafcfc76f2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.964310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.985375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:32.988024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fc8b3-f580-43f5-9d34-4fbb17d3d53a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:32.992370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:32.993312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:32.993783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:32.994238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:32.995230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:32.995732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:32.997385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.017565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 267/530] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:33.020616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.026690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.027491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.027770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.028046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.040944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.042667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:33.065054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:33.065996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:33.067214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:33.067214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:33.067214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:33.067214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:33.067214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 264/531] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:33.067553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.151075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efc406-dd14-44f4-baab-14631b9951de None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.192103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.193051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.193361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.193624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.195144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb5653-c1b9-4e97-907e-8e11c7fcf4e0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.208544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.210508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:33.236495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:33.237443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:33.238895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:33.238895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:33.238895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:33.238895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:33.238895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 268/532] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:33.239159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.239637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.240597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.241123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.241721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.243152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=8fe3582d28dc473ebf4d7265c331c602) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:33.243700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.245378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.248501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:33.261453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 265/533] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/role_assignments?user.id=8fe3582d28dc473ebf4d7265c331c602&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:33.262760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.293309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:33.361747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c8595-e6a2-45d3-bafa-fdff2d37f14d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.400945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.401674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.402215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.402751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.403507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:33.404128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.405407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.420530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 269/534] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:33.426107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.531665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e839005-f836-45f6-a37d-be5375c0750a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.551344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59c7b1-96e9-4c7c-8202-b2b4acad8e73 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.556108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:33.600792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.601492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.601779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.602063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.602797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:33.603108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.604492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.627771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.628581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.628864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.629170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.634650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 266/535] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:33.639879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.645116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.650035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:33.680394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:33.681420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:33.682264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 270/536] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:33.688828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.721554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:33.766239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fea71-a3bb-4c91-8eeb-5843afbaa3ad None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.802157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.802948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.803232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.803506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.811951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.813609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:33.829545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:33.830433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:33.831257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:33.831658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 267/537] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:33.838466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:33.899860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc024f7-3e37-4b01-8065-a92f6c5ba925 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:33.940686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:33.941726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:33.942283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:33.943422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:33.944440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:33.945126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:33.948289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:33.975663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 271/538] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:33.981179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.020362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:34.023076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b17c2-d3b2-41f9-aaf1-f6852c7daa3d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.047441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:34.075726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.076913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.077230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.077509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.078311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:34.078625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:34.080055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:34.109964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 268/539] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:34.116548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.143784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f058ef5-0363-4329-8640-be96be311eb4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.225747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.226416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.226702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.226980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.227827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=aa4c9120fd7344858fb5054d32faed64) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:34.228145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:34.229660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fecb74-57f6-47cb-b550-5ca51f62c4d5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:34.241434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 272/540] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:33 2022] GET /identity/v3/role_assignments?user.id=aa4c9120fd7344858fb5054d32faed64&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:34.276890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2cdf-cc63-412b-bc25-8c0ba0eecd5d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.277228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2cdf-cc63-412b-bc25-8c0ba0eecd5d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.277487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d2cdf-cc63-412b-bc25-8c0ba0eecd5d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.279374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 273/541] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:07:34.282494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9052f8-41ab-4813-a34a-c16c79aa8b40 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.290596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.290904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.291156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.327783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:34.329406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:34.340737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.341602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.341798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.342084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.342931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=13212d1708cc4c00867ebf6d713559d4) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:34.343252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:34.344836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:34.365308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 269/542] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:34 2022] GET /identity/v3/role_assignments?user.id=13212d1708cc4c00867ebf6d713559d4&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:34.422810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 274/543] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:34.446201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.506789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:34.578545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4cd2b7-a802-4395-a164-cc5e86c1c8be None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.614930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.615739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.619147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.619147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.629262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-454cfc51-bffd-43a3-b2f1-9c2e5c021666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:34.637405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:34.639234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:34.640022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 270/544] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:34.645101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.648485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b916-c813-40d1-8e5e-38b6fd1570c3 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.648781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b916-c813-40d1-8e5e-38b6fd1570c3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.649175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f069b916-c813-40d1-8e5e-38b6fd1570c3 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.653062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 271/545] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:34.657190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.657190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.657190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.668444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:34.677075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:34.678577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:34.756635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 272/546] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:34.781870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.788067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a712b4f-7145-46db-88b7-02635d1345b1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.818461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:34.858294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.859571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.859571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.859571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.860355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:34.860665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:34.862068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:34.880851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 275/547] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:34.887670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:34.897052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197279b-91c2-4b24-8e4b-4148c7944633 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:34.973180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:34.973998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:34.974285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:34.974564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:34.997308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:35.009897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:35.010842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:35.011630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:35.021091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 273/548] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:35.025375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.037378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.072150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a44d6-96bb-491c-b8fb-3da0c13f6b38 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.115375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.116087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.116367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.116639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.128491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.130039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:35.148296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:35.149308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:35.150186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:35.150186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:35.150186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:35.150186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:35.150186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 276/549] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:35.155178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.210038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.237546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649828c-1cf2-44d0-b08d-5cd9d67f4941 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.257405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195eed2f-9c28-4288-a68e-96b963d13434 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.292270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.292939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.293252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.293532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.294265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:35.294705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.295327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.305328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.320487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.321204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.321546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.321826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.322585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:35.323143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.324525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.328663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 277/550] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:35.333798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.349255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 274/551] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:35.353988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.494524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5edecf-85db-47b7-bd7e-3d24c1b93edb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.531145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.531995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.532279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.532589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.551157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.552603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.558735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee195-036a-44cb-babb-eaddcd401c91 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:35.570525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:35.571400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:35.572250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:35.572250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:35.572250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:35.572250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:35.572250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 275/552] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:35.579065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.593963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.595823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.596631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.596915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.597220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.604734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.607915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:35.638146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:35.639851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:35.640747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:35.648134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 278/553] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:35.649145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.741495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.770897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f926-edec-43d1-852b-3943288c4ff4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.797788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37869-50e4-423f-a4a8-477984be3d3e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:35.817401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.818104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.818392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.818674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.820164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:35.820787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.822521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2fed9-ea1a-4f8f-803d-72d9ecefb8c7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.833984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:35.834653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.834935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.835211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.835937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:35.836242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:35.837648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c796ac-abd6-4a0e-b3ac-46b544b2f243 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:35.845474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 279/554] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:35.847305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090317-8750-4b44-9fbb-c3e32cc7613a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.847612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090317-8750-4b44-9fbb-c3e32cc7613a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.847899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090317-8750-4b44-9fbb-c3e32cc7613a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.849476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 280/555] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:35.851437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59090317-8750-4b44-9fbb-c3e32cc7613a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.858884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 276/556] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:35.860282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:35.860576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:35.860851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:35.882724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:35.884080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:35.955337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:35.965793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 277/557] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:35.967008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:35.990235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59090317-8750-4b44-9fbb-c3e32cc7613a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.000276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.031806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.033064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.033837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.034234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.049310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.051630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:36.077750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:36.079325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:36.080189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:36.080189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:36.080189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:36.080189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:36.080414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 281/558] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:36.082068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.091246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d035-6520-41ed-8509-2993a75cf4e0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.129325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.130435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.130895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.131346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.139430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.141292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:36.157778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:36.158722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:36.159724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:36.166865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:36.168068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.206750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc484a9-b1b5-4b3e-bec4-ca3183add33c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.233073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.254749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.255560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.255853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.256133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.268300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:36.276553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:36.277522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:36.278339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:36.280316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 282/560] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:36.280316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.292728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea95d8-3416-4420-b401-f767080cef26 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.305280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.340445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.343238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.343879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.344427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.345615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:36.346490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.348538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.365412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 279/561] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:36.367344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.398963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27825d18-ab5a-426f-8ccb-1db43cbebdb4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.445676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.446694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.447170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.448405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.449451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:36.450383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.453389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.477292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 283/562] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:36.478129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739f371-a715-4937-8fec-38f02ceec274 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.478792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.497628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.517392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.518114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.518792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.519075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.520251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:36.520564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.522578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.533751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:36.535242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.584519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.609745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a61b0-8dbb-4a00-b53a-a538ded6cfef None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.644369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a301c-043d-4c81-9807-5b83937ea6f5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.648882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.649705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.649991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.650267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.658525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.663200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:36.673981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:36.675020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:36.676529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 284/564] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:36.680441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.683108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.683758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.684037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.684300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.735060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.757345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.758796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b452b-dbe0-4282-92b1-4a351a54b101 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.784889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b887b-e7e4-428c-8885-c97d5b955e8c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.819382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.820325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.820610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.820896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.827865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.832015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:36.833520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-28bb48a7-eddd-4bb1-be3c-620e13c3c8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:36.850901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:36.851766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:36.852647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:36.852647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:36.852647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:36.852647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:36.852647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 285/565] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:36.853267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f5a7-aab8-4bd5-820f-7ae4fb911e52 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.853549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f5a7-aab8-4bd5-820f-7ae4fb911e52 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.853824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95f5a7-aab8-4bd5-820f-7ae4fb911e52 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.855147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 286/566] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:36.855811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95f5a7-aab8-4bd5-820f-7ae4fb911e52 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 281/567] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0a1c-0bdc-4bd6-a141-cff605615d26 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0a1c-0bdc-4bd6-a141-cff605615d26 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be0a1c-0bdc-4bd6-a141-cff605615d26 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 282/568] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:36.869762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0a1c-0bdc-4bd6-a141-cff605615d26 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:36.948693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:36.963923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95f5a7-aab8-4bd5-820f-7ae4fb911e52 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.973771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be0a1c-0bdc-4bd6-a141-cff605615d26 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:36.997933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:36.998843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:36.999127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:36.999399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.000191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:37.000504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.001959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895356d7-7b5e-49d8-89ea-be97dc09770e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.008408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.009076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.009359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.009629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.010346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:37.010650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.011977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.014213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 287/569] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:37.015415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d232-4b73-4f3b-b9fa-23300c3d9a2c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.015708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d232-4b73-4f3b-b9fa-23300c3d9a2c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.015990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623d232-4b73-4f3b-b9fa-23300c3d9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.027855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 283/570] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:37.027855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.032516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e623d232-4b73-4f3b-b9fa-23300c3d9a2c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:37.033758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e623d232-4b73-4f3b-b9fa-23300c3d9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:37.079537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.113128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 288/571] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:37.113128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.113128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.113128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.118076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:37.119279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:37.124376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1c640-fec2-4de1-b1f8-8d15d506b27f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.159941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.160741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.161052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.161320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.168070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.172883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.174350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.187056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 289/572] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:37.187866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:37.192868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:37.193952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:37.194886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:37.194886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:37.194886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:37.194886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:37.194886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 284/573] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:37.195578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.292572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b113f8-db6f-4e76-9e42-9ac08a1e871d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.298067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90205834-9e8e-4578-9178-50df7e871e45 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.303524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.327175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.328106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.328715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.329186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.331315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.332100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.332380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.332662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.339977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.341444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.343731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=1bd3f89d420e4418babdbac8736d8fa5, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.345192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:37.355701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:37.359931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 285/574] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:37.360882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.406394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.433538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 290/575] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:37 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:37.434384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.463595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eea14f-566a-4e89-ae12-10bdc295a1e5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.502579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.503487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.503831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.504109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.516404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:37.524560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:37.525803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 286/576] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:37.526651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.555545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd92bce-8aea-41eb-a11c-e206d71d70b4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.596964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.598561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.599425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.599425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.599985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:37.600183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.601608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.613983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 291/577] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:37.614626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.640728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.646813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43e146-fc0e-47c0-9cc4-b4756b653e6e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.659367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.684300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.685181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.685462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.685733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.696378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:37.704767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:37.706051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:37.707048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:37.714530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 287/578] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:37.719749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.732764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945a10e-9ca4-4c5b-ae48-9b2cc0057ad5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.767602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.768274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.768553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.768823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.769691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:37.769998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.771413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.789617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 292/579] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:37.790438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.830236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d67d6-f062-43aa-b47c-5b82d6978dfc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.869145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.869808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.870087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.870359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.871611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:37.871966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.874204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.875005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.887300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 288/580] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:37.887300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:37.900448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595bdcf-4fb2-446b-b645-165efa0fd0e5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:37.922292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:37.938611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:37.939512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:37.939865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:37.940203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:37.947180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:37.948854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:37.964351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:37.965465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 293/581] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:37.967483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.005063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84121286-4915-4b18-81d1-1df46f8b83ca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.042079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.042739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.043019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.043295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.044034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.045059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.046415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.059361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 289/582] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.059361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.081136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0fae6-ac3a-4cfb-b760-a2f5a87619da None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.119063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.119849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.120134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.120408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.128661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.134818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.136406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.158751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:38.158916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:38.159743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:38.160629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:38.160629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:38.160629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.160629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:38.161407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 294/583] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:38.161658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.169800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537cf0-72ca-4a9a-bb03-7cb026ad6413 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.205438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.206907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.207200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.207478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.220306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.221806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:38.239435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:38.240329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:38.241530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:38.241530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:38.241530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.241530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:38.241530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 290/584] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:38.242155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.280880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad90a37-067d-4485-8e25-d4207e0eef6e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.315676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.316334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.316619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.316896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.317739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.318052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.319494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.331705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 295/585] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.332721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.358077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8cea-a662-46c6-9c61-394a83920174 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.383497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.396005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.396802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.397113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.397392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.410140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.411590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.418226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:38.429171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:38.430272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 291/586] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:38.431177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.440204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a4d0d1-bbf0-41a8-a8c4-f6c22ea56151 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.477084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.477680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.477964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.478241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.478974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.479280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.480658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.492910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 296/587] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.493748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.548654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df67c8-241d-4d02-a5a4-96dd2dbcc5b1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.584705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.585400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.585691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.585967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.586699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.587007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.588365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.601151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 292/588] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.601956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.611190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e79da-6b12-470f-89ae-3a89e1b3b9a2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.623232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.648746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.649449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.649735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.650011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.650837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=f43a49de2754455795ab92ede9138eb2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.651149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.652593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.658063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 297/589] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/role_assignments?user.id=f43a49de2754455795ab92ede9138eb2&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.658872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.766331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:38.821772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6e356-c552-4985-a1d6-90f4895d2258 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.853225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b803cf56-6c43-4a2c-9e00-c653681c5e65 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:38.864718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.865416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.865698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.865973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.867059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:38.867365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.869217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.888915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 293/590] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:38.888915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.901624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:38.903393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:38.904272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:38.905052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:38.915932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:38.918584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:38.940042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:38.940956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:38.942581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:38.945358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 298/591] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:38.946440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:38.994988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.023176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b00794-b67a-4dde-b7b8-2a71441927e6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.042850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.063105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.064247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.064825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.065771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.077512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.079639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.080029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d0e2-f682-4209-91a7-7b127066c889 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:39.098859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:39.099834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:39.100750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:39.107458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 294/592] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:39.107458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.127836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.129797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.130281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.130999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.139787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.141800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:39.167104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:39.168151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:39.169086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:39.173182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 299/593] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:39.177627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.238956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2497b9-c977-4b66-be54-cfdf3bb2fcf6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.275685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.276670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.277180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.277670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.279167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:39.279672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.281387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.295511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 295/594] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:39.296743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.312330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.321855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81e66cf-5a66-455f-9a96-88691836daa8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.343514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.372167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.373824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.374113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.374391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.375452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:39.375764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.377774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.407632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 300/595] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:39.407632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.418922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2636c3-d910-437c-b378-82b76e094235 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.456916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.458001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.458736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.459201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.460232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:39.460838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.462589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.483236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 296/596] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:39.484392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.521921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a709c42d-c116-4ab0-b798-727fd198ea4b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.557834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.558790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.559072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.559342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/8fe3582d28dc473ebf4d7265c331c602/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.576245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=8fe3582d28dc473ebf4d7265c331c602, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.577703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5020b5-befc-4ff8-83d0-787c41f90ef3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.580385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.586303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96f93-1c17-4749-8561-b2ab4fba76fb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.619446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.620227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.620513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.620790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.631612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.633050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:39.650434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:39.651319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:39.652190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:39.652190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:39.652190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:39.652190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:39.652190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 297/597] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:39.652470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.677569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 301/598] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:39 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/8fe3582d28dc473ebf4d7265c331c602/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:39.680323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d4555-c782-4872-a963-2549fea2c268 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.680820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d4555-c782-4872-a963-2549fea2c268 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.681525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d4555-c782-4872-a963-2549fea2c268 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.683090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 302/599] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:39.684080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d4555-c782-4872-a963-2549fea2c268 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.697040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.797976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0fe66-6905-4e4d-b03e-fb79225a94d3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.841989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.842721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.843006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.843280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.855569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.857611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.858058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d4555-c782-4872-a963-2549fea2c268 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:39.868860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f988bc77-81d9-443f-a669-b3b3c8223a25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:39.880939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:39.881960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:39.882828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:39.882828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:39.882828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:39.882828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:39.883498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 298/600] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:39.884382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.884667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.884947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.901675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:39.902886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:39.907609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:39.908494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:39.908950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:39.909424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:39.910397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:39.910881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:39.913054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:39.928652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 303/601] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:39.929892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:39.993825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 299/602] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:39.994913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.012501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.072415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff23351-36d5-493e-a91e-acc17aa04b0d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.119682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.120280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.120646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.120990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.121915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:40.122288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.124423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.136683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a7f5c5-f991-4eaa-8541-e76d18ab7a33 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.141156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 304/603] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:40.142122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.170906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.177303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.178369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.178858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.179295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.187257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.189185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:40.204593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:40.205564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:40.206447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:40.209168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 300/604] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:40.210149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.265943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d8fda-6a27-46ac-80f3-070fc639409d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.296327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.310243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.311861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.312409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.313309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.327986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:40.338501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:40.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:40.340290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:40.340916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04eb22-f74b-4b7e-8c3e-989e6616154c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.348427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 305/605] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:40.348427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.387612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.389889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.390469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.390985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.398702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.400539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:40.416542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:40.417488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:40.418378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:40.421627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 301/606] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:40.422648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.473722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4eb056-a325-45fc-88dd-10d7c43b1673 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.493447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.518942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.520006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.520491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.520969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.522518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:40.523073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.525152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.541890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 306/607] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:40.543079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.557181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4eebd-fe3b-4c4c-8903-b200625efc31 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.598122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.609084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.609761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.610040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.610313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.611117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:40.611417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.612772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.626983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 302/608] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:40.626983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.717668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f169d6-b086-43d1-b5d0-f768fc4811be None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.761073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.761883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.762260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.762629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.764091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:40.764495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.766037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.783119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 307/609] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:40.783119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.790582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9705e-3254-430c-99a2-804073608775 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.803825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.825666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.826609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.826891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.827163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/aa4c9120fd7344858fb5054d32faed64/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.844363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=aa4c9120fd7344858fb5054d32faed64, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.846048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed1dab0-3af1-46c9-a21f-7e06c70d2eb8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.894081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09620c23-edfd-4a79-9f2d-9a436af3e3cc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:40.895640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:40.927809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:40.928607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.928888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.929224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.939546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:40.941091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:40.942810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 303/610] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:40 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/aa4c9120fd7344858fb5054d32faed64/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:40.953654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7524-82f4-40c5-ae92-b26f8e9fa6bd None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.953940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7524-82f4-40c5-ae92-b26f8e9fa6bd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.954218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671c7524-82f4-40c5-ae92-b26f8e9fa6bd None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.959857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 304/611] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:40.959857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c7524-82f4-40c5-ae92-b26f8e9fa6bd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-835ac3bc-e497-4c3e-bb1a-22cb466d95ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:40.968149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:40.972549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 308/612] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:40.982061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:40.999282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:41.000919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:41.100850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 309/613] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:41.101674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.102064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671c7524-82f4-40c5-ae92-b26f8e9fa6bd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.142711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.143970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.144488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.144861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/13212d1708cc4c00867ebf6d713559d4/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.165389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=13212d1708cc4c00867ebf6d713559d4, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.167012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.195310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:41.211716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5d168-c696-41e0-adf2-f14953c255b1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.236630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 305/614] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:40 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/13212d1708cc4c00867ebf6d713559d4/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:41.241674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.267656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.269466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.269754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.270030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.270780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:41.271792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.274623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.278940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:41.302000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 310/615] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:41.307434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.465195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7497841a-9548-46c5-9865-5d9c83427d9f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.489323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619435ad-b86c-4009-987a-718df6988c54 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.507948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.508759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.509076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.509390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.521988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:41.530808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:41.531289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:41.532404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:41.533449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 306/616] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:41.534832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.535288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.535703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.538118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.545830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.547484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:41.568067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:41.569243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:41.570405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:41.571973 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 311/617] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:41.585997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.589767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:41.628612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:41.660801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b32a529-1d5d-4cc3-80e6-53245e3bd139 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.698422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.699495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.699926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.700349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.702245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:41.702702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.704350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.715724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 307/618] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:41.722716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.809572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cc6fe-41da-4a80-af42-d3501071a4dc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.871674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8e13-28b5-4319-99e6-288cf15dfa59 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:41.880981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.881695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.881978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.882255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.883217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:41.883531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.885093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847b35d6-663f-4487-8ec6-56e08c7b02f1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.915272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:41.916344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.916462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 312/619] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:41.916871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.921439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7433b6-a4c7-4a17-a340-077a5135ad82 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.921439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7433b6-a4c7-4a17-a340-077a5135ad82 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.921439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7433b6-a4c7-4a17-a340-077a5135ad82 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.921439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 313/620] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:41.922219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.925876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7433b6-a4c7-4a17-a340-077a5135ad82 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:41.935708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:41.938114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:41.939695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d80a56b4-83c0-4fbf-b3d9-9f3155754e14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:41.962539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:41.963472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:41.964350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:41.964350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:41.964350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:41.964350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:41.964350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 308/621] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:41.965636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:41.965636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:41.966988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:41.990799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:41.992346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:42.002151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.055885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7433b6-a4c7-4a17-a340-077a5135ad82 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.068336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 309/622] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:42.069206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.115440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.116099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.116640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.116926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.199429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96fd13f-0508-4c90-9e07-b807b77edc5f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.214185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.215833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.219683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.239186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.240208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.240688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.241281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.242206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:42.242705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.244265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.257669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 310/623] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:42.258941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.302197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.360842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 314/624] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:42.360842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.378434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028040c-0fce-4fe6-8966-d69106352916 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.424067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.425155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.425444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.425720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.440840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:42.452922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:42.453877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:42.454719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 311/625] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:42.455414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.472729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ef6e3-3ec9-4707-96ab-eecde83112ed None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.507469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.510352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.511441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.511923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.512394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.521429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.523235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:42.538958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:42.539959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:42.540926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:42.543678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 315/626] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:42.545452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.574667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.599227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1f50a-db02-402f-b2d1-e911837608ba None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.644971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.645723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.646007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.646287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.661772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.663240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.678513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab5a4a-9b3c-443d-807b-0d717711a58c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:42.687929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:42.688873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:42.689812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:42.689812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:42.689812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:42.689812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:42.689812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 312/627] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:42.690087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.723328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.724728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.725451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.725925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.727518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:42.728010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.730600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.742316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 316/628] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:42.743465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.795585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.808708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2d744-6807-4f8b-b9f5-119c89a587c2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.836641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:42.846449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.847230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.847667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.847973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.848943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:42.849374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.850967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.856220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd6cf2-8e13-46b5-b6c5-eec6100dac60 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:42.870101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 313/629] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:42.871090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.897632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:42.898690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:42.899130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:42.899551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:42.900501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:42.900967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:42.904216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:42.917397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 317/630] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:42.918444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:42.983315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474db0b-2c2f-41dc-bd28-17042ce3be3e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.020000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.020910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.021339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.021714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.029580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fa9ad2-3c83-42fd-952f-3164678669c8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.033363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.035083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.042320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:43.054951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.056083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.057199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:43.057199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:43.057199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:43.057199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:43.063536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 314/631] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.063536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.075144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.076191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.076696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.077148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.089130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.090787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.094283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:43.110607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.111782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.112873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:43.112873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:43.112873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:43.112873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:43.114838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 318/632] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.115781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.171180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c7f5-206a-426f-9220-22f33b52e9de None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.210551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.211500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.211886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.212272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.220548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.222150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.229069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af110bb5-2634-4b26-9a9c-e1298562ce09 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:43.236227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.237374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:43.238452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:43.239356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 315/633] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.240068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.270772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.271599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.271962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.272335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.273208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:43.273704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.275090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784408-70a3-4956-a9b0-1933d3c34fff None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 319/634] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0a86a-4867-4cb1-b07b-22ed640257cd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0a86a-4867-4cb1-b07b-22ed640257cd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0a86a-4867-4cb1-b07b-22ed640257cd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 320/635] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:43.292499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0a86a-4867-4cb1-b07b-22ed640257cd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.311376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.352232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.355262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e760a-06a5-42e6-9149-dc333b238111 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.392129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.392889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.393270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.393613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.394408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:43.394785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.396222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.399887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0a86a-4867-4cb1-b07b-22ed640257cd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.413046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 316/636] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:43.413046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.442921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.443627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.443988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.444274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.445089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:43.445405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.446829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd68871b-86e6-4cc9-a0e9-f1fc591f6524 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.464719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 321/637] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:43.464719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.464719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.464719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.479338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:43.480564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:43.523084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b0583-079d-4db1-979f-677142a51d52 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.541371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.557176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 322/638] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:43.558064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.558300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.559167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.559452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.559778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.567327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.569185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:43.584929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.585993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 317/639] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.592143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.604240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.656370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275425-e8cb-4021-ace4-987d56c461a1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.688201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606df630-5974-4e4e-a4eb-7d17120efc6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.689346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.690145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.690437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.690713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.697338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.698990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e4014cce-c4b6-4e2c-8655-8aae5fa3b4bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:43.712571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.713698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:43.714617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 323/640] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.715361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7553-7c83-4ba8-9e8d-cbb0dafcea76 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.715604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7553-7c83-4ba8-9e8d-cbb0dafcea76 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.715886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f7553-7c83-4ba8-9e8d-cbb0dafcea76 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.717709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 324/641] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:43.718402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7553-7c83-4ba8-9e8d-cbb0dafcea76 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.726815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.727474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.727763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.728040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.728876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:43.729253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.730666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.736758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 318/642] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:43.737582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.801792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.836334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f7553-7c83-4ba8-9e8d-cbb0dafcea76 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.844693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:43.871525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe6d1a-8505-4b71-a80b-b50696d4d5ce None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:43.874859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.875758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.876189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.876592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.888314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:43.896561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:43.897567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:43.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 325/643] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:43.899479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:43.920190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:43.921693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.921979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.922259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.923108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:43.923423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:43.924848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596edc5f-e180-4f43-8e3a-6412d04bc66a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:43.943942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 319/644] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:43.946043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:43.946341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:43.946625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:43.968510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:43.969691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:44.027766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f92459-4557-4d97-ad75-3da7e4c06c3c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.043507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 320/645] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:44.044386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.074859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.081291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.085511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.105112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 326/646] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:44.105112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.131439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.150936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf6410b-7aa8-442d-8206-fd315133695b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.186768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.187436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.187716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.187988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.188736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:44.189064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.190424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.203866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 321/647] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:44.203866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.214237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21461fea-5425-4f17-85d1-667ee78c7a2c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.250791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.251506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.251881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.252287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.298592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.308945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90efba1-d736-4519-9bf6-86d6c9aaade9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.323278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.324726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.347210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.348091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.348441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.348779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.352269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.359273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:44.367052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:44.368156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:44.369015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 322/648] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:44.369857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.430139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 327/649] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:44.430984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.480144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6994dde-e89e-499a-97db-06f94507bb96 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.516242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.517065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.517354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.517629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/f43a49de2754455795ab92ede9138eb2/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.533094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=f43a49de2754455795ab92ede9138eb2, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.534772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.548863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d73b5-f958-4fa2-a26f-2933674a6781 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.573629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.581576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.582360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.582667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.582941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.594275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.595710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:44.612481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:44.618321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 328/650] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:44.619247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.639863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 323/651] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:44 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/f43a49de2754455795ab92ede9138eb2/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:44.640898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.643485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.754258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2b189-601a-48a7-ae52-e2796c22ae8a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.769100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68aceb2-4def-4212-9155-3231ac6c4630 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.804868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.805602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.805882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.806156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.806907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:44.807212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.808572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.812884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:44.813825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:44.814201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:44.814593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:44.817625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 329/652] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:44.818459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.830089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:44.832368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:44.855573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:44.857325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:44.858400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:44.858400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:44.858400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:44.858400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:44.860327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 324/653] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:44.861549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:44.879443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.945384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:44.959278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3d8a1-2b12-493e-8ddc-598f27a79032 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:44.986255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f99d1-5285-4c2a-b9e0-54188cd76086 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.002151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.003088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.003587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.004004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.004880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.005362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.006870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.024145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 330/654] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.025313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.031508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.032484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.032862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.033324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.046794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.048515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:45.074198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:45.075126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:45.076055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:45.076055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:45.076055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:45.076055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:45.080522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 325/655] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:45.081593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.142208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.145644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd796-3741-4c0f-bfa7-8153d2e916e9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.190234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.191305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.191656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.192020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.193109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.193493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.195411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.201086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079ed23-f2f2-4384-875c-6adb9fe722f8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.209122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.209556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 331/656] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.211086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.238952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.240142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.240661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.241248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.251536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.253550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:45.270395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:45.271339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:07:45.272285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:45.275144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 326/657] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:45.276276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.324262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334980b4-e570-433d-9d82-907d590cb554 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.361812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.362837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.363315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.363778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.364718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.365246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.366797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.380737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 332/658] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.381977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.404406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.413001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f320fe-6c63-434d-8bee-55cd65aa1fda None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.458227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.459020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.459299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.459570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.468743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.470798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:45.488339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:45.489294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:45.490171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:45.491632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef33ce8-e905-4e32-8d5c-627f749e7696 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.492851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 327/659] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:45.493997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.523711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.539614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.540378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.541005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.541307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.542142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.542740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.545083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.569099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 333/660] 10.222.0.27 () {56 vars in 1137 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.571169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.608022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa0c2c-8be8-487f-8e71-acfe37bac025 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.645668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.646461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.646742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.647016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.655710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.657374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.670746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:45.675318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:45.676250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 07:07:45.677200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:45.679984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 328/661] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:45.680982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.707180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34b8704-e52b-420d-a31d-d20e383499ff None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.757434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.758591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.759015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.759455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.761553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.762070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.763710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.777555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.781529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 334/662] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.782535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:45.798603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872d694-61db-4c2c-8045-08458f19bb11 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.847009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.848433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.848867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.849338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.897712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523f3f-0c81-473d-b555-16ca0ed11255 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:45.930619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.932065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb0af6-4f6b-4bad-82de-1b0db0671038 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.935707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:45.935920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:45.936171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:45.936440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:45.937295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:45.937604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:45.939110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:45.947586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:45.963027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 335/663] 10.222.0.27 () {56 vars in 1139 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:45.963906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.027482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 329/664] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59abb2-14da-4fd4-9b39-4ce8ee92988e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59abb2-14da-4fd4-9b39-4ce8ee92988e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59abb2-14da-4fd4-9b39-4ce8ee92988e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 330/665] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:46.048266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59abb2-14da-4fd4-9b39-4ce8ee92988e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.089232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecdbef2-5895-40f3-a145-42e6b1f9dcb4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.124308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.124965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.125314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.125591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.126426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=8fe3582d28dc473ebf4d7265c331c602) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:46.126741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.128165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.145059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 336/666] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:45 2022] GET /identity/v3/role_assignments?user.id=8fe3582d28dc473ebf4d7265c331c602&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:46.145059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.173924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59abb2-14da-4fd4-9b39-4ce8ee92988e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.215526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.216408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.216772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.217169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.223518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.274640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc4a3-d244-4bcb-93d0-f88dede2422c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.285371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.300631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.302141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.319348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.320158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.320443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.320718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.334644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.336120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-39e23afb-b1e6-4e95-a3fe-7decbc6f5bf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:46.357641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:46.358541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:46.359421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:46.359421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:46.359421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:46.359421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:46.360999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 337/667] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:46.362375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.362796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.363203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.382506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:46.383901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:46.424489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 331/668] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:46.429583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.476980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 338/669] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:46.478071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.528149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.548314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.571820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5d1a5-2ec2-4c48-bc67-af126e5a32c5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.589404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a892a6b8-d01b-4293-bb5e-ce89b6617180 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.620163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.621485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.622668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.623204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.624280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:46.624817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.626528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.626809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.627340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.627627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.627905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.639131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.640645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.645655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 332/670] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:46.645655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:46.661103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:46.662215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:46.663234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:46.663234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:46.663234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:46.663234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:46.666852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 339/671] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:46.667703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.766973 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.774299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1a5ab-4046-4b39-aa68-1c15ec4cffa0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.775534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a01ac-b79f-4fb2-81bc-89c4f545b019 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.811745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.812575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.812692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.812919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.813223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.813399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.813684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.813962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.820370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.821821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.825940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fdde5a07-76f9-482f-a2ea-7b46c3962f60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:46.833578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:46.834471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:46.835389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:46.836480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:46.837362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 340/672] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:46.845124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 333/673] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd5a9-b315-4fab-af67-cf8d56f39d96 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd5a9-b315-4fab-af67-cf8d56f39d96 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbd5a9-b315-4fab-af67-cf8d56f39d96 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 334/674] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:46.845679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbd5a9-b315-4fab-af67-cf8d56f39d96 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:46.854725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:46.952252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbd5a9-b315-4fab-af67-cf8d56f39d96 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.957048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370de86-531b-4ba9-b6af-742f9c11f70c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:46.990964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.991713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.991997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.992274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.993044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:46.993350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:46.994719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:46.996392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:46.997229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:46.998019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:46.998298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:46.999092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:46.999403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.000822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e6a759-b036-41d0-8da3-1ed82f75ec2a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.005258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 335/675] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.006209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.016038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 341/676] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.017393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906433-75aa-477d-926a-d85f0f400375 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.017737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906433-75aa-477d-926a-d85f0f400375 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.018118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75906433-75aa-477d-926a-d85f0f400375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.035162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-75906433-75aa-477d-926a-d85f0f400375 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:47.036855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-75906433-75aa-477d-926a-d85f0f400375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:47.048123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.083084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.114230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 342/677] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:47.115696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75906433-75aa-477d-926a-d85f0f400375 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.116683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef25b4-9882-477e-86d5-c36649aebd69 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.151955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.152624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.152907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.153229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.154064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:47.154376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.155785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.168338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 336/678] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.173922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.227589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75906433-75aa-477d-926a-d85f0f400375 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.261846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.262630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.262936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.263195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.273495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.274928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.275880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d3b2d-84b7-4e4f-88df-57c1bfb73ac7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.277459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:47.292780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:47.296130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 343/679] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:47.297085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.310269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.318488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.319283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.319563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.319835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.327418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.328841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:47.343721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:47.344710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 337/680] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:47.346300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.406348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa1da6-6dbb-4c1f-9bfb-9f0b9bac62cf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.441576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.442381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.442658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.442932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.453314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e29051-c08f-4e98-8227-3fff7d09ce0f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.454436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:47.462628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:47.463793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:47.464805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:47.467432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 344/681] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:47.468314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.494542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.495118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.495402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.495678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.496509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=aa4c9120fd7344858fb5054d32faed64) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:47.496821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.498951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.505063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 338/682] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/role_assignments?user.id=aa4c9120fd7344858fb5054d32faed64&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.511486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.531928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.588935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e44c9-147e-4dc1-91d9-ba6484580139 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.594029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.632703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.633423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.633712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.633994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.634815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:47.635131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.636618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.655143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 345/683] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.656074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.664242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3631104-8952-4893-a1d0-8749df29e09f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.706360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.707024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.707307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.707585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.708380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:47.708691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.710369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.724406 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 339/684] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.726138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.795695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507629a3-7426-4dc0-9952-018bbb8f5e2a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.815917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.834969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.835656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.836004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.836279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.837125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:47.837438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.838813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.847865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 346/685] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:47.848734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.856055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5553196f-b8e5-4b04-beac-484f24a9ef5e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:47.873898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:47.899733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:47.900843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:47.901306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:47.901710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:47.913176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:47.915071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:47.935454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:47.936496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 340/686] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:47.938469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:47.972384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9349aac-bc9b-4271-9fbd-d0cba7de70a4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.008251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.008969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.009301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.009582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.010430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=13212d1708cc4c00867ebf6d713559d4) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:48.010746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.012248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.019196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 347/687] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/role_assignments?user.id=13212d1708cc4c00867ebf6d713559d4&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:48.020013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.123729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8017e9-499a-4f2a-88e7-463fb478ae65 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.128700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.186683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.187500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.187780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.188050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.211705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.213618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:48.237779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:48.239339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:48.240726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:48.240726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:48.240726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:48.240726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:48.240726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 341/688] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:48.245747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.248720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929f6c-816a-4da6-be15-20a4a1294e92 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.275093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.288895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.289643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.291680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.291680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.291680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:48.291680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.292719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.314154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 348/689] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:48.320540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.365649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95254ab4-70b3-471c-bf89-2b5ad33413df None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.407306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.408258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.408737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.409217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.410215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:48.410798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.412324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.429120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 342/690] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:48.431485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac73b5a-fd5e-434c-a042-38b0151c2b43 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.432003 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.433406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.473236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.474154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.474573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.474987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.545432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.553965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11934b0c-b126-4885-b1d8-fd6126d55b30 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.557955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.559418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70a3a4-b696-463d-b821-a397a2274ebb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.600749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.601952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.602592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.603085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.612597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.614450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3dd9ae01-741e-4407-b796-bc8beb3a0f8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:48.630625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:48.631710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:48.632640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:48.635050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 343/691] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:48.641530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a17d-41f2-45da-b6fc-94b0bd9b8872 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.642192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a17d-41f2-45da-b6fc-94b0bd9b8872 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.642669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708a17d-41f2-45da-b6fc-94b0bd9b8872 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.644824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 344/692] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:48.645828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a17d-41f2-45da-b6fc-94b0bd9b8872 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.674084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.677927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 349/693] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 07:07:48.679195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.679485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.679804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.696373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:48.697589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:48.768625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708a17d-41f2-45da-b6fc-94b0bd9b8872 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.776689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 350/694] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:48.777860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.822418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.824241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.824533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.824815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.826381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:48.826868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.828331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.853012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 345/695] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:48.854181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:48.857929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.909633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ed53-7fee-4bf0-a59c-58c57df8c1d6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.941076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:48.948318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:48.949443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:48.949932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:48.950928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:48.961994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:48.963741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:48.983219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:48.984531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:48.985482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:48.985482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:48.985482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:48.985482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:48.985719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed815211-6580-4c2d-82a7-274dc9bb0b6c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:48.992231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 351/696] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:48.993339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.029520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.030318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.030605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.030880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.049663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.051117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:49.075282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:49.076227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:49.077557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:49.077557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:49.077557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:49.077557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:49.081090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 346/697] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:49.082288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.115516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2543f9-4076-4da3-a5af-542497af17df None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.140624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.159973 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.160633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.160918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.161239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.192677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d4a6c-4cf5-459d-a72d-8ee853e747c1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.229270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.232041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.232965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.233492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.234061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.234990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:49.235501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.237095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.253231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.253231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.253645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 347/698] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:49.254749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.375875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 352/699] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:49.377196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.377623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eada8-c443-45fe-bc1d-ec5b25f29f62 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.393747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.414756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.415782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.416301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.416779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.417773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:49.418286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.420784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.435240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 348/700] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:49.436702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.498828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.524558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864fabc-ea69-409a-9ff2-addad642366e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.562860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6737226-02c2-4936-8621-6b88dc953c6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.568365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.569464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.569978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.570454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.578776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.580477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:49.595883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:49.596783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:49.598053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:49.604936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 353/701] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:49.605602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.607227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.608119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.608402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.608676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.623028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.624590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:49.650048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:49.650989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:49.651934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:49.651934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:49.651934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:49.651934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:49.651934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 349/702] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:49.652639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.684778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.720100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb541e-f2c5-4d67-b2f5-52ec0c944e57 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.756082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.756672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.756954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.757260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.757956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.759389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1501e78-2fbf-44ba-ad92-bc97f010c8dd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.762167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedd30-6628-4a0f-ba0f-26ed07bf7b01 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.797064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:49.797731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.798019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.798296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.799089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:49.799401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:49.800837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:49.812777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 350/703] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:49.813608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.828097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.834628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 354/704] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:07:49 2022] POST /identity/v3/users => generated 254 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:49.843623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f62e-5ef8-469f-b6d5-16915f1f4f63 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:49.843984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f62e-5ef8-469f-b6d5-16915f1f4f63 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:49.844266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132f62e-5ef8-469f-b6d5-16915f1f4f63 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:49.849088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 355/705] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:49 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:49.849088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f62e-5ef8-469f-b6d5-16915f1f4f63 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:49.932901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:49.954857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3e032-7764-4bb3-91be-31a479af3dad None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:49.996323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132f62e-5ef8-469f-b6d5-16915f1f4f63 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.002681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.003621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.003910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.004636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.006850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.006850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.008251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ac199-af0e-4c6d-b8dd-89a496cc7309 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.024803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 351/706] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:50.026727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.027023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.027306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.033661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.034323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.034601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.034875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.035705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.036014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.037526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.045414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 356/707] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:49 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:50.045763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.050654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:50.051671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:50.125708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.155866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 352/708] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:50.178532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad712fe4-9e3d-40a3-ad15-6fd08d2620b4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.180625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.222946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.223848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.224075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.224349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.233330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.234867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:50.250614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:50.251541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:50.252427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 357/709] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:50.258146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.282380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.306837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b7b92-8171-4647-af22-85e36f027783 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.344139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.345356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.345847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.346343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.347218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.348800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.361968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fdeb6-84ff-4dac-b23e-3cadd6a1ba01 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:50.364215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:50.365430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:50.366319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:50.369093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 353/710] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:50.377358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.393583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.402351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.403014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.404081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.404515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.405341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.405646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.407082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.419989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 358/711] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:50.425598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.513874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaabeff-fb97-4ca6-9101-309ace49b7e0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.551796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.552718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.554731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.555254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.556167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.556629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.558198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.564546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 354/712] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:50.570356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.574573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.599312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e2bcfc-993a-45fc-80e4-6c25c6eb567b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.646416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.647574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.648031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.648744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.650637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=f43a49de2754455795ab92ede9138eb2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.651116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.654201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e297532-4913-46dd-988b-a5ce968f1244 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.661439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 359/713] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/role_assignments?user.id=f43a49de2754455795ab92ede9138eb2&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:50.663753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac56b-3518-4a79-84ab-e23c435dd075 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.664185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac56b-3518-4a79-84ab-e23c435dd075 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.664865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dac56b-3518-4a79-84ab-e23c435dd075 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.667413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 360/714] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:50.675165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.675450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.675732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.691781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a167a4a-7578-4cdd-88aa-b9d42b05473b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:50.696296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:50.697082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:50.733392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:50.734339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:50.734793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:50.735206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:50.736058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:50.736517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:50.738049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:50.744703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 355/715] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:50.753673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.800115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 361/716] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:50.835707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:50.936498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:50.985056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cd858-91bc-4ee6-9868-e8e8fbbd343b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:51.024366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:51.025262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:51.025554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:51.025830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] PATH_INFO: `/v3/services/network` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:51.026560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:51.027934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:51.040585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:51.041667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:51.042527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 356/717] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:50 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:51.051164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:51.155793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ad498-1b7b-4413-baea-54ac4d8ebb47 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:51.196455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:51.197176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:51.197465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:51.197745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:51.198728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:51.199040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:51.200478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab789825-6ce5-49f0-aed1-5459d028bea8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:51.205692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 362/718] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:07:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:51.211055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:51.332829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc4d9-f80c-4c67-8209-e3a65c4ff244 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:51.370540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:51.381059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:51.381059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:51.381059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:51.381059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:51.393492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:51.393492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:51.393492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5653e-d0ed-4833-9c7e-a31ce09c74e1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:51.393492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 357/719] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:07:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:52.380138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4ea5-ee7c-43ab-a93a-ac18f81258c9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.381164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4ea5-ee7c-43ab-a93a-ac18f81258c9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.381656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4ea5-ee7c-43ab-a93a-ac18f81258c9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.383473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 363/720] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:52.390176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.390634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.390813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.418254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:52.419668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:52.443920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a872bd-f2eb-49d0-93be-15fc099ee23f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.444538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a872bd-f2eb-49d0-93be-15fc099ee23f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.445046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a872bd-f2eb-49d0-93be-15fc099ee23f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.447338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 364/721] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:52.453594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.454276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.455135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.482179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:52.483359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:52.542901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 358/722] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:52.563921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:52.569836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:52.626659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 365/723] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 07:07:52.796747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:52.797055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2117f4a-b01e-482c-8eb4-fd68beae8254 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:52.829423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:52.845284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:52.846084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.846363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.846637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.862448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0579d9-ad64-4c71-abc2-398b0cedb34f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:52.869129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:52.877607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:52.878598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:52.879499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:52.892411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 359/724] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:52.893413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:52.941787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:52.942596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:52.942877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:52.943151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:52.972533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:52.981117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:52.982670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:52.983598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:52.984245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 366/725] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:52.989879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.050695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.104484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce134ed-e2c6-483f-b80f-59592f1f279a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.171802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.173080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.173582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.174058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.175032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:53.175550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.177159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.187447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 360/726] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:53.193677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.199143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eab155-1a79-4143-a268-8ef9a955cee6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.247750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.248448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.248737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.249036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.249863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:53.250321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.251797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e597d72f-eea9-4f50-9e79-6e2d50ceced2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.254785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.261776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 367/727] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:53.263426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01559af-e8f5-4393-a05c-3883c3cfa697 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.263722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01559af-e8f5-4393-a05c-3883c3cfa697 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.264004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01559af-e8f5-4393-a05c-3883c3cfa697 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.265582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 368/728] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:53.270163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01559af-e8f5-4393-a05c-3883c3cfa697 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.322526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e254211-ce13-416d-9727-e7f81c2c3740 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.370035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.370821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.371108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.371387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.382134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.383833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.385339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.396726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01559af-e8f5-4393-a05c-3883c3cfa697 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-826aca50-f3af-4241-9639-84269f0c6ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:53.407440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:53.408728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:53.409653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:53.409653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:53.409653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:53.409653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:53.413489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 361/729] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:53.414837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.415131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.415414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.432638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:53.433985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:53.440690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.441790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.442292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.442778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.456673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.459053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:53.482144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:53.483112 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:53.483984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:53.483984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:53.483984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:53.483984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:53.486588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 369/730] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:53.487611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.517239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 362/731] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:53.518198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.551041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.603901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5e61c-1259-4970-a934-4a25ca0d32a9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.625320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9cb17-4141-4efb-8bba-2e27c33ce062 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.643351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.644024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.644308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.644584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.645339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:53.645650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.647453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e6da-1105-49e2-bbf3-95f8e6e2999c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.666635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 370/732] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:53.667765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059002-5e0f-4dfe-b9c8-b5c40f6f4a49 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.668055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059002-5e0f-4dfe-b9c8-b5c40f6f4a49 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.668333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059002-5e0f-4dfe-b9c8-b5c40f6f4a49 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.671246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 371/733] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:53.671246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059002-5e0f-4dfe-b9c8-b5c40f6f4a49 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.675801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.676204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.676481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.676772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.677079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.678249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:53.678597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.679934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.693635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 363/734] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:53.698469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:53.800818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:53.811364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b58978-4e78-41f4-8851-25eb6cdbb125 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.847029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.847843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.848129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.848407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.856079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.858069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-67dbeb45-4973-419a-89bd-28ead270340c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:53.874713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:53.875688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:07:53.876616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:53.877856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 364/735] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:53.878118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.878365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.878641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.895401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:53.896579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:53.901252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059002-5e0f-4dfe-b9c8-b5c40f6f4a49 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:53.934980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:53.935695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:53.935976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:53.936249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:53.936961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:53.938341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15c932-4e87-42ed-8d9f-9b2ce6d864e6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:53.963877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 365/736] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:53.964849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.031922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 372/737] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:07:53 2022] POST /identity/v3/services => generated 251 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:54.033268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cf98-2af6-4a43-bb92-b57340f97a68 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.033630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cf98-2af6-4a43-bb92-b57340f97a68 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.034013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809cf98-2af6-4a43-bb92-b57340f97a68 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.035702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 373/738] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:54.035964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809cf98-2af6-4a43-bb92-b57340f97a68 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.053781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.076308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf4e5d-43d4-4451-bf1e-991239aa3f04 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.110239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.133263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.133789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.134080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.134361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.143748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.150638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.155355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809cf98-2af6-4a43-bb92-b57340f97a68 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:54.161195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:54.162171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 366/739] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:07:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:54.167794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.202834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.203781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.204692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.204692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.205199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:54.205507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.206932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82603cf3-c881-4728-b8d1-48f8e7f21459 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.228095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 374/740] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:54.229413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.229695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.229966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.246620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:54.247935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:54.284570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82efc8-9d6b-44cb-97d7-a9c13ac5b8cb None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.329051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 375/741] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 07:07:54.329051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.330245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.331227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.331521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.331845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.334944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.344897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:54.353142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:54.359616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 367/742] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:54.360521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.385560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.435569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519615fb-df17-45a7-8ffb-883d5a48b6b0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.465579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde79406-da3d-4c1c-941c-ce8ebebef09a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.471837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.472520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.472800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.473493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.474349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:54.474660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.476754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.496320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 376/743] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:54.496320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.506814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.507459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.507746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.508035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.570632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.578247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.579708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.608311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a18da0-2b88-4ee5-bcc3-9ab2255500e5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.619332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.651465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.652754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.653305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.655769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.655769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.656927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.719377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 377/744] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:07:54 2022] POST /identity/v3/services => generated 240 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:07:54.720329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.743850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 368/745] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 07:07:54.745121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.859438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:54.866881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9989b3-ac0f-44c9-bc27-c393ae8305c1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.868869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c8f3d-463f-4929-9a92-3375f72a3c04 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:54.910026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.910728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:54.910850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.911012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.911274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.911839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:54.912118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:54.912390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:54.913169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:54.913474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.914831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.926676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 378/746] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:54.926849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.928094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:54.929728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:54.949491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:54.951181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:54.952174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:54.952174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:54.952174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:54.952174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:54.952174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 369/747] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:54.952962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:54.963763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.050560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ce552-d8d6-40e7-bf0f-388836f6b163 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.064630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16cdac-3bc2-4ccc-a0c6-74cd564f7ae7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.087586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.088489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.088776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.089069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.100919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.102171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.102402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.103383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.103872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.104484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.117102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.118818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:55.121338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:55.122748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:55.123623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:55.123623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:55.123623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:55.123623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:55.123851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 379/748] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:55.124747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.132323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:55.143214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:55.149471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 370/749] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:55.150357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.233593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.259631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd43f2-b0df-4b67-a36f-655ee11674fe None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.266914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f3d1e-9386-46d3-b6aa-8f674ec7b985 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.296990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.297660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.297947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.298225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.298953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:55.299259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.300862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.312645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 380/750] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:55.313583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.314374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.315291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.315774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.316530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.317829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:55.318014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.319360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.332763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 371/751] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:55.333652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.404510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.428876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea8be-4b49-476b-bdc5-96ab834c69c7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.458375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ef5b9-60ab-42fa-81ba-e5bfc91d4bf8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.464835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.465588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.466471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.466992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.467739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:55.468157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.469669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.478951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.483987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 381/752] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:55.484917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.501717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.502519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.502804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.503084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.513225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.515425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:55.535650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:55.536578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:55.537513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 372/753] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:55.538460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.610279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5888d34-6315-4d41-b3f3-43bc4e7f9cf8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.653861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.655437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.656073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.656508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.665892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.666584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f660e-cddc-4cc1-aaac-707c0029823c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.667940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:55.686834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:55.687752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:55.688638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:55.689091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.691927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 382/754] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:55.693165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.706832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.708078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.708379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.708658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.719948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.721431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:55.740430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:55.741459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:07:55.742402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:55.744997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 373/755] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:55.746021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.767980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:55.815186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8002d9-466d-4a96-abf5-83a031ca1642 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.848982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf15344-2363-455f-9248-d721cfae303f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:55.853415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.854084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.854425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.854703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.855496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:55.855806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.857421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.871171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 383/756] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:55.872692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.887027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:55.888220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:55.888771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:55.889286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:55.890270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:55.890817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:55.892442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:55.905413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 374/757] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:55.906539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:55.954715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.011486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebadcb2-5be5-4e21-9776-c7de0ed16f35 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.015571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f62707-73df-4ac8-8994-e0eb94d10bda None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.035756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.050472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.051405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.051686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.051959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.052983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.053904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.054030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=1bd3f89d420e4418babdbac8736d8fa5, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.054566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.055059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.055433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.056321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:56.056841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.058948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.078107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 384/758] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:07:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:56.079784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.170161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 375/759] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:07:55 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:07:56.170995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.189805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d23d3-307c-4863-a9e6-cc45749a88dc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.239436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.240117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.240402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.240679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.241567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=9fe24e20dfe24dc3904bd0b8831c1c7a) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:56.241884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.243416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207806d8-2f03-4695-af3a-c8dad8f65f83 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.250596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 385/760] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/role_assignments?user.id=9fe24e20dfe24dc3904bd0b8831c1c7a&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:56.252079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a408e-fb8b-4785-8f15-8f76bf512d0b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.252374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a408e-fb8b-4785-8f15-8f76bf512d0b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.252653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a408e-fb8b-4785-8f15-8f76bf512d0b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.258751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 386/761] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:56.262118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.262318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.263033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.281920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:56.283284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:56.299529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.303597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d1d73-82bb-4880-8125-c1a9e611a20a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.324792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.344653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.345800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.346302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.346831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.362824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 387/762] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:07:56.387216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.441319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.442812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.507773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b703b3b-481c-4659-9657-af65c780de4f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.546814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.547547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.547830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.548107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.548768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.550175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.550877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.554969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 376/763] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:07:56.561399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:56.568501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:56.569581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:56.570455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 388/764] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:56.576075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.658355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.675344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc75fc5-4b17-4fcd-acde-6dd212ba8586 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.711616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.712421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.712709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.712987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.725089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.726581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:56.746300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:56.748103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:56.749626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:56.749626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:56.749626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:56.749626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:56.749626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 377/765] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:56.753702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.762859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630704d9-922c-4484-ade5-837ae0e801ae None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.843132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.843762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.843919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:56.844027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.844304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.845055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:56.845373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.846747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.859185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 389/766] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:56.866149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d2698-51c7-46d6-8069-8f59c3887a50 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:56.873322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:56.905980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:56.907041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:56.907556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:56.908047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:56.909049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:56.909574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:56.911178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:56.924317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 378/767] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:56.929990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.037239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9531f69-b74b-4c3b-bdab-e8c9baec9960 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.053512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.077811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.079560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.081839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.082334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.097411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.101850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-cd2067f0-cbfa-4b39-ad04-01b5d0cf2de2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:07:57.123335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:57.124459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:07:57.125549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:57.128216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 379/768] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:07:57.129002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.134459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a06fc-78bf-4daf-8278-b5297ca93a6b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.134675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a06fc-78bf-4daf-8278-b5297ca93a6b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.134966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a06fc-78bf-4daf-8278-b5297ca93a6b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.136388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 380/769] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:57.136953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a06fc-78bf-4daf-8278-b5297ca93a6b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.143121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a5e35-1e9e-47a9-afd1-29af0fd09fda None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.183367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.184093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.184924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.185433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.186245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:57.186558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.187929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66d9d8-70f9-4f25-a619-faa4a4f607d1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.194813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 390/770] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:07:56 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:57.200000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.200000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.200000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.216413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:57.217770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:57.281298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a06fc-78bf-4daf-8278-b5297ca93a6b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.297386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 391/771] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:07:57.298522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.321335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.322678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.323514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.324132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.325227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:57.325749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.327605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.343201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 381/772] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:57.348971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.389640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.421078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.428216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf91926-dc6e-4ded-8cd0-1db60cc3dfd7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.466655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.467894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.468648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.469238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.470622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] RBAC: Adding query filter params (interface=public, service_id=24f9bff3a3ed4a0eadd7f5c7ce02d6d5, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:57.471076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.472549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.480417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6a8d0-0a76-4ac1-9dbf-809227c653d3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.482079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 392/773] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/endpoints?service_id=24f9bff3a3ed4a0eadd7f5c7ce02d6d5&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:57.487124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.525147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.527506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.527982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.528639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.529543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.531143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:57.551039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:57.552523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:57.553372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 382/774] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:57.554186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.618934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af8e851-edf4-4c17-9fc3-24bc8d07fbb2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.657330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.663468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.664194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.664532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.664867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.665014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7bad4-975e-44cc-ad5c-9f961c9eebb4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.665835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=f43a49de2754455795ab92ede9138eb2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:57.666204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.669501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.677104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 393/775] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/role_assignments?user.id=f43a49de2754455795ab92ede9138eb2&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:57.678125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:57.733425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.734442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.734867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.735281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.737101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:57.737409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.739600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.750374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 383/776] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:57.855503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5329b7-0723-4c47-b5fe-c8e272331d9e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:57.896994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:57.898074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:57.898556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:57.899040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:57.900053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] RBAC: Adding query filter params (name=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:57.900557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:57.902249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:57.909124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 394/777] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:57.914468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.039721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc176bf-9c3a-44e0-a3b9-4975edb5468c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:58.086651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:58.087595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.088041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.088475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.089426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] RBAC: Adding query filter params (type=network) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:58.089880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:58.091933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:58.098035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 384/778] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:07:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:58.105752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.237909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:58.253851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafada4-e74b-4616-be26-5a7d00039108 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:58.294239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:58.294910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.295183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.295451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.296242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] RBAC: Adding query filter params (interface=public, service_id=62e47639d51744d3b7ee11e3473b62f9, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:58.296550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:58.297939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa2e0f-2d4a-49f2-a657-a998d2721399 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:58.309218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 395/779] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:07:58 2022] GET /identity/v3/endpoints?service_id=62e47639d51744d3b7ee11e3473b62f9&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:58.314899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.373759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:58.474842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54663f-eecc-4b11-9373-95ff966db329 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:58.520597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:58.521649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.522136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.522608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.523532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:58.525116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a91bd-0b29-4f6d-93f5-f264c241de90 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:58.537056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 385/780] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:07:58 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:58.587749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895432-c593-4f4a-bff5-8df439179c5e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.588086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895432-c593-4f4a-bff5-8df439179c5e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.588308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55895432-c593-4f4a-bff5-8df439179c5e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.590042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 396/781] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:58.602992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.603509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.603586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.626134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:58.627350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:58.673111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e3d-4e87-4d8e-96bd-330e881b0acc None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.673625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e3d-4e87-4d8e-96bd-330e881b0acc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.673701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e3d-4e87-4d8e-96bd-330e881b0acc None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.675386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 397/782] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:07:58.698839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.699189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.699392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.721972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 386/783] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:07:58.734197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:07:58.735765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:07:58.746144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.771067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:58.837137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 398/784] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:07:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:07:58.859603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.865888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccfb39-7a55-4126-87b3-5409074e3e85 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:58.916901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:58.918550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:58.918550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:58.919367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:58.933871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:58.944586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:58.945777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:58.946921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 387/785] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:58.956079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:58.962101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:58.996731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf8b7-86a3-4396-a1c7-ec1f26786b27 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.063656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.071132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.072197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.072646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.075885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.086659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3053b2a-36d5-49fa-89e5-7425713c1a7f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.101594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:07:59.110111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:59.111024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:07:59.111840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:59.122692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 399/786] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:59.124888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.125597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.125884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.126163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.126927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:59.127240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.128521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.128955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.139349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 388/787] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:59.144762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.262274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51acfc79-af90-460d-956c-f2ed5093f669 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.302327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.303122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.303408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.303684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.315385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.318444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.319922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:59.339509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:59.341395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:59.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:59.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:59.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:59.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:59.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 389/788] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:59.347615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.363147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08b229-8cca-472d-aaf9-9e29073b0ff0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.461132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8213da-0f1a-4e1c-9906-e9a7e5031b1b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.489781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.490467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.490751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.491025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.491780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:59.492086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.493483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.497528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.498453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.498745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.499026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.499764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:59.500076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.501836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.515410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 390/789] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:07:59.519485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 400/790] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:07:59.520854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.525968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.531123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.601005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.650111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c437ac-b24e-43d9-976d-4d46158b5c75 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.661551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128e8cb-4bdc-4de8-b7e1-68f8949d837c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.708247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.709082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.709373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.709652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.709771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.710498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.710780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.711053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.717299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.718797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.730734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.732703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:07:59.738133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:59.739071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:07:59.739997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 391/791] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:59.746515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:07:59.771698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:07:59.772655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:07:59.773599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:07:59.773599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:07:59.773599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:07:59.773599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:07:59.780249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 401/792] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:07:59.786037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:07:59.881978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4374593-92df-4a45-baaf-ee60424197f1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:07:59.894966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.913698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:07:59.958429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:07:59.959479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:07:59.959958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:07:59.960428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:07:59.961522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:07:59.964099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:07:59.965873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:07:59.985857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c37c-6020-4d74-a6fe-34b9f6aed5e7 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.005830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 392/793] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:00.009636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.036870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.037615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.037902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.038177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.038913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:00.039207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.040618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.059017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 402/794] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:00.072252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.132334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69623b-2ccb-4817-b56c-fab0c0d42507 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.168828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.170140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.170633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.171132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.183063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.185552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.200031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc6c5-556b-48c3-9a75-26f2b36a05d6 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-4a1d7f8c-48fb-4323-b677-65cd40832f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:00.205902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:00.206773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:00.207656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:00.207656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:00.207656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:00.207656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:00.209949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 393/795] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:00.211562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86919b-3056-4ace-9bf1-8e4376884aa3 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.212048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86919b-3056-4ace-9bf1-8e4376884aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.212532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86919b-3056-4ace-9bf1-8e4376884aa3 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.214665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 394/796] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:00.214827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.216514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86919b-3056-4ace-9bf1-8e4376884aa3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.238370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.239505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.239933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.240380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.241896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.251458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.253445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-53c34ab3-2907-46e4-92f9-c2f39d98d2c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:00.269461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:00.270443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:00.271371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:00.273695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 403/797] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:00.275082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.275529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.275962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.295231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:00.296850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:00.329513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86919b-3056-4ace-9bf1-8e4376884aa3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.365342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.366167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.366515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.366856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.367652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:00.368027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.369490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.373366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 404/798] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:00.374460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.382323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 395/799] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:00.393128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.480452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.498795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c9d3d-448e-409c-880a-9cac1a09dfae None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.501490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f102f-1c61-47f6-9212-fdd57714869a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.504284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.534665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.535459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.535739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.536018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.537324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.537999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.538284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.538556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.539395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:00.539705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.541158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.543058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.545009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.559431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 405/800] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5a5ff5b8-06ac-4a65-85b2-109efba6a84d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:00.559599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:00.560412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:00.561707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:00.564712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.565349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 396/801] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:00.566453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60033-7cf9-4e99-8415-dfc9920d3628 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.566742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60033-7cf9-4e99-8415-dfc9920d3628 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.567016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d60033-7cf9-4e99-8415-dfc9920d3628 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.569062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 397/802] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:00.569062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d60033-7cf9-4e99-8415-dfc9920d3628 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.674261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5b81a-1ce0-4209-87ad-61bf75396be8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.688401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d60033-7cf9-4e99-8415-dfc9920d3628 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.710740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.711538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.711821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.712096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.722942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:00.724706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.725380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.725686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.725961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:00.730562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:00.732247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 406/803] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:00.738308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.743586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.763672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.802155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.803964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.839619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab5dd7-62e9-4d34-adf6-3708c4e80318 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:00.875886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:00.876549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.876828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.877144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.877936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:00.878242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:00.879664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f0590-2710-4650-b871-bdec0431171e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:00.892453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 407/804] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:00.893732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:00.894005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:00.894273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:00.910899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:00.912068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:00.920002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 398/805] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:00.921051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:00.975771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:00.985056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 408/806] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:00.985884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.012082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.038796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1727cfe-02fe-437c-bdab-477d05742d94 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.074681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.075610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.075892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.076164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.076911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:01.077244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.078608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.092392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 399/807] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:01.092392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.104437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5d183-5f5b-441f-874f-7a9e715e4598 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.139186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.140069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.140352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.140628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/9fe24e20dfe24dc3904bd0b8831c1c7a/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.155777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=9fe24e20dfe24dc3904bd0b8831c1c7a, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.157335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.195385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de289919-5386-4823-b633-e63a3e5a279b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.197641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.228710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.229473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.229759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.230036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.238036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 409/808] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:00 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/9fe24e20dfe24dc3904bd0b8831c1c7a/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:08:01.239001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.241491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.243290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:01.262306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:01.269927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 400/809] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:01.270803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.335611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.378172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f35f4-45b0-4728-a46a-b8ed256daf63 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.381764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373196ca-cd0b-4787-beb0-b3dda4739ce3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.424670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.425519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.425802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.425905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.426098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.426637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.426742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.426937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.427193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.428068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.439201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-45e786fe-0c45-4de4-9086-37d5d5ffda70 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:01.440448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:01.441399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 07:08:01.442244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:01.443052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.443122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 410/810] 10.222.0.27 () {56 vars in 1129 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:01.443122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb4f4-3d08-4fd9-bc2f-5252e1df710f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.443251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb4f4-3d08-4fd9-bc2f-5252e1df710f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.443904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0fb4f4-3d08-4fd9-bc2f-5252e1df710f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.444912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 411/811] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:01.449435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb4f4-3d08-4fd9-bc2f-5252e1df710f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:01.469128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:01.470088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:01.470992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:01.470992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:01.470992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:01.470992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:01.470992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 401/812] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:01.471271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.484293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.567993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0fb4f4-3d08-4fd9-bc2f-5252e1df710f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.581526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf860f7-a717-44ca-b376-56d66a2158f9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.594492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.603595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.604257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.604539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.604811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.605573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:01.606916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.608002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9de90-b709-4ffd-8ce2-3e32b48351e1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.618348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.619017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.619312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.619592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.624921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 412/813] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:01.629487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:01.629487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.629694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.629694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.629694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.629940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.629940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 402/814] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:01.630111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.641856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:01.643039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:01.716226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.724162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 413/815] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:01.724162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.759584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a525d9-0116-40cf-b69d-b2a4e530067f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.796299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.796961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.797274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.797553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.798279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:01.798586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.800127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.816602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 403/816] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:01.816602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.830267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033771-2cd7-4641-9893-b81063906b3f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.847630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.867572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.868370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.868654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.868927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.876602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.878882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:01.894575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:01.895489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:01.896359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:01.900506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 414/817] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:01.901106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:01.922319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbcd40-d5e2-43c0-b9ff-db5a0f4c1adf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:01.954036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:01.959588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:01.960320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:01.960590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:01.960862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:01.961619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:01.967263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:01.967263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:01.973334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 404/818] 10.222.0.27 () {56 vars in 1124 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:01.974231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.016802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f18b24-9d4e-48d5-a87f-2ecafda4f893 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.050107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.050899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.051183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.051460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.052110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.053575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:02.065341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:02.066314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 07:08:02.067149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:02.071394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 415/819] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:02.072211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.082008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b5f3a-173b-46b1-8fe0-e2448d7b28ca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.114087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.122676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.123467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.123752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.124020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.131692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.133243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:02.148081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:02.149050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:02.150012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 405/820] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:02.150608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.178492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b475b6-57bc-43b0-a7d6-537cf54148ae None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.210298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.214392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.215057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.215341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.215706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.216481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:02.216794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.218247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.230198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 416/821] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:02.231033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.262829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa54181-4569-4990-bb74-4a975156d0e8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.302160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.302743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.303081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.303600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.304019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.305410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.332990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.335999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1c7e39-c2b6-4afd-85d3-9f5a70f67b19 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.374358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.375026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.375309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.375581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.376288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:02.386858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.386858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.386858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 417/822] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:02.386858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.411921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 406/823] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:02.413219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.512312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3fdfbd-9fec-43ff-96ba-0725f47170c9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.545094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd87e8e-1f5d-4003-8bf9-247b3bf8d865 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.556143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.557407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.558099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.558477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.558872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.560947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:02.561305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.562769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.585411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.586066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.586344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.586619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.587463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:02.587782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.588500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 418/824] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:02.589312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.589527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.597802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 407/825] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:02.598443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.641778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.721407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00687ca4-fb89-47c1-8567-c93f64b128ca None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.738582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b9c410-aec9-47f3-ad71-a570f431b810 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.764600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.765422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.765713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.765991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.766719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] RBAC: Adding query filter params (type=network) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:02.767032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.768428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.775364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 419/826] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:02.781536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.788414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.789251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.789538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.789817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.805688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.807687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:02.828057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:02.829010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:02.830604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:02.830604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:02.830604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:02.830604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:02.830604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 408/827] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:02.835099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:02.870217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.897909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:02.918133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a78ede-991b-49f1-9cbd-1e314434cccc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:02.958849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:02.959740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:02.960120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:02.960495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:02.961410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:02.962930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.068421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 420/828] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:03.093419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e96979-5c4e-40b4-9efa-2f2db336e535 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.153850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.154716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.155004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.155278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.156046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:03.156352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:03.157776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ab748-0ec7-4ecc-bd62-9fb1917e6ada None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.173575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 409/829] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:03.179303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.318855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced34bd-f961-49cf-aa11-daf4f15c4cda None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.330983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a4908-43b1-4499-8cf1-45826d73b52c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.331311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a4908-43b1-4499-8cf1-45826d73b52c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.331536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a4908-43b1-4499-8cf1-45826d73b52c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.333052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 410/830] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:03.338135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.338659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.339116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.359633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:03.359823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.360509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.360798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.361101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.361946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:03.368273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:03.369746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:03.385815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:03.386741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:03.387894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 421/831] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:03.393990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.397117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:03.454379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 411/832] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:03.484880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.510923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:03.531897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207cd57f-44b3-413c-8754-2fee139889be None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.574603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.575734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.576010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.576285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.577123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:03.577436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:03.578913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.591935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 422/833] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:03.597693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.621529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8198fe-5d40-4529-b3f2-a66937fad4e3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.668064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:03.668272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.669982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.670263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.670538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.683905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:03.694209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:03.695155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:03.695991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 412/834] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:08:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:03.704026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.721134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959128b1-0c83-4e75-8613-fa851f0e45a3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.765849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.767194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.767485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.767765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/f43a49de2754455795ab92ede9138eb2/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.770221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=f43a49de2754455795ab92ede9138eb2, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:03.772232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.785192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:03.817105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19977a2d-aa19-4024-a7c5-db75daba30e2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:03.857131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:03.857131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:03.857131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:03.857131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:03.857677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:03.857677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:03.857677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:03.858456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 423/835] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:03 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/f43a49de2754455795ab92ede9138eb2/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:08:03.866612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 413/836] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:03.873479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:03.994755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca1035-879f-477f-b20e-16b8154e2e32 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:04.020455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:04.036504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:04.037379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.037669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.037947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.052589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:04.054146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:04.074108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:04.075784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:04.076666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:04.076666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:04.076666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:04.076666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:04.076666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 424/837] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:04.082925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:04.187468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cb463-4e86-4dd9-9b3f-0a4dd50bcd6e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:04.217800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:04.222789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:04.223453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.223738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.224013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.224732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:04.225050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:04.226417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:04.239269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 414/838] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:04.244761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:04.351751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b956c350-1ece-4b52-a61a-07ade72a63a8 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:04.389296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:04.390503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.390989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.391466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.399827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:04.401612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:04.421903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:04.422892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:04.423831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:04.426589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 425/839] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:08:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:04.432399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:04.538084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de44354-110f-4073-aa12-ab4787d27e90 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:04.578610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:04.579283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.579565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.579840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.580680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:04.580991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:04.582447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:04.601332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 415/840] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:08:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:04.607240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:04.657368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:04.714241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010aea8-05f9-4fed-b815-1a8671195a0f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:04.749320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:04.749969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.750249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.750521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.819525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:04.820889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44ea414-0e17-4f89-a66b-d4bdbabd606f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:04.854956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:04.922619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 426/841] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:04 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:04.928522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:04.961466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5102c-5aed-42f7-a035-07adb6ca4e04 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.961779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5102c-5aed-42f7-a035-07adb6ca4e04 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.962029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab5102c-5aed-42f7-a035-07adb6ca4e04 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.963626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 427/842] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:04.970903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f47a-89d8-4dbf-8435-222937e5d690 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:04.970903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f47a-89d8-4dbf-8435-222937e5d690 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:04.970903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5f47a-89d8-4dbf-8435-222937e5d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:04.989652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-18a5f47a-89d8-4dbf-8435-222937e5d690 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:04.991070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18a5f47a-89d8-4dbf-8435-222937e5d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:04.994417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.049724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b4988-6cef-4c7b-8848-9c0ebb73a49b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.071732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 428/843] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:05.073719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332206-1f01-4cfa-95a2-6ae3cf8689ff None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.074218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332206-1f01-4cfa-95a2-6ae3cf8689ff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.074722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332206-1f01-4cfa-95a2-6ae3cf8689ff None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.077201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 429/844] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:05.082140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.082428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.084037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.094317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.095573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.096077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.096579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.102524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:05.103746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:05.108634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.110138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:05.128299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:05.129400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 416/845] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:05.130283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.179406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.187953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 430/846] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:05.188942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.246718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e56218-6a02-41f6-8c17-89963f6d8282 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.249494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.283978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.284780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.285094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.285376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.286068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.287437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:05.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:05.301060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.305957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 417/847] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:05.306776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.306844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef27cc-da3d-487f-8a35-aa028784c1df None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.340042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.341269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.341556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.341831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.342549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.342853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.344247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.355243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 431/848] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:05.356058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.414507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.416447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667aca3-2c39-4959-a94d-d04d9e918277 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.452408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.453685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.454120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.454568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.455490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.457121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.458542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61cbbf-a965-447c-901d-b29f5b95ae71 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:05.471045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:05.472177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:05.473228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.480370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 418/849] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:05.481942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.494194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.494854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.495139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.495410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.496118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.496419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.498205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.502585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 432/850] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:05.503354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.519843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.595505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c553-9331-4d6b-a235-a77712f014f1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.606333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e05c0-d2c7-43c2-9613-5c19b4734712 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.623642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.633713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.634497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.634779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.635059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.642726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.643195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.643394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.643719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.643994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.644632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.644740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.645067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.646382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.655835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 433/851] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:05.655835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:05.664414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:05.665482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 419/852] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:05.666394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.763736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.771834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6dab-b1fd-42a4-9cd8-0fd6154a309a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.773829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8060e3-e71c-4195-8afd-509aced47c74 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.807519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.808299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.808584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.808859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.810117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.810326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.810600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.810890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.811174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.811452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.811967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.812162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.812470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.813876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:05.817137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 434/853] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:05.817664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:05.837457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 420/854] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:05.879809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:05.947117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63217220-e2df-4926-9c8e-85f4c182d244 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:05.988031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:05.988705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:05.988986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:05.989290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:05.990096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:05.990404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:05.991864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb61c4-9da4-4488-af8a-ca06f10c5a66 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:06.007148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 435/855] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:06.012764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.049972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4216a7-214f-41c2-9b6f-eb39fb41a45d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.050495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4216a7-214f-41c2-9b6f-eb39fb41a45d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.050953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4216a7-214f-41c2-9b6f-eb39fb41a45d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.052480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 436/856] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:06.059593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.059905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.060150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.077015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:06.078259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:06.131467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab81f3-1fda-4331-8273-1e2bf7973fe7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:06.148351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 437/857] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:06.173681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.179772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:06.180705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.181229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.181803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.182845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=9fe24e20dfe24dc3904bd0b8831c1c7a) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:06.183361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:06.185825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:06.193178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 421/858] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/role_assignments?user.id=9fe24e20dfe24dc3904bd0b8831c1c7a&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:06.211009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:06.289073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911b846-9d45-427c-89ee-bbda08bbc81a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:06.328820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:06.330053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.330539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.331016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.344193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:06.352420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:06.353431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:06.354295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:06.357141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 438/859] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:06.361058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.383363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:06.474751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f2b86-7958-4047-8f04-cc3e6a58dfd6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:06.511067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:06.512104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.513362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.513911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.514929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:06.515446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:06.517081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:06.526450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 422/860] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:06.533064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.633845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:06.640493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4212e0af-4951-4239-a401-04ffb7e3a3e4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:06.676260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:06.677067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.677355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.677657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.688664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:06.690219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:06.708879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:06.709840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:06.710726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:06.710726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:06.710726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:06.710726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:06.714739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 439/861] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:06.716275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.799157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:06.818871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999f0dc3-8c2d-4003-8a5d-935c656e7eb9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:06.853121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:06.853833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:06.854120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:06.854397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:06.855119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:06.855428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:06.857069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:06.873144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 423/862] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:06.875996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:06.982677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738e95e0-2a19-4307-86eb-09a3e519bedc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:07.022845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:07.023739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.024023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.024352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.033605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:07.035074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:07.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:07.053105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 07:08:07.055286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:07.058710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 440/863] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:07.058900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:07.160242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af426a9-f6a3-4a29-aaf1-6b524b587c87 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:07.193476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:07.194146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.194431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.194712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.195552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:07.195868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:07.197315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:07.206696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:07.219850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 424/864] 10.222.0.27 () {56 vars in 1135 bytes} [Tue Jul 12 07:08:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:07.221431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:07.233888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:07.330894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf0795-8c88-498e-842b-a21e8a0bb7d5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:07.366332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:07.367337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.367816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.368284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.440194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:07.442014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:07.452960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:07.547616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 441/865] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:07.553555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:07.657571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c2133-9d5e-4c3f-85b5-28384b0a7aa9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:07.692573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:07.693391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.693672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.693941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.704561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:07.706005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:07.723841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:07.724749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:07.725685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:07.725685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:07.725685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:07.725685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:07.725685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 425/866] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:07.730788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:07.833941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b07df-e840-4bc7-a8dd-6fcd739b0216 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:07.844074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:07.870157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:07.870834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.871117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.871398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.873133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:07.873448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:07.874834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fb61c-ec72-451a-b335-cd951f4a6d48 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:07.892855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 442/867] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:07.894201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:07.947152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:07.965202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd86f-dd34-4689-906f-2355d2a34f66 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.965548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd86f-dd34-4689-906f-2355d2a34f66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.965802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcd86f-dd34-4689-906f-2355d2a34f66 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.967501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 443/868] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:07.975848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608c92-6bbe-44af-98cb-f886858a53a8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:07.976138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608c92-6bbe-44af-98cb-f886858a53a8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:07.976416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12608c92-6bbe-44af-98cb-f886858a53a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:07.994898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-12608c92-6bbe-44af-98cb-f886858a53a8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:07.996085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-12608c92-6bbe-44af-98cb-f886858a53a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:08.009569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f955248-fb35-4078-baf6-b19c48b97791 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.047868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.048790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.049007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.049294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.056067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.057530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a219fea7-2621-4dae-9691-a28e1add068a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:08.072291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:08.081313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 426/869] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aad52-3698-4d21-b24a-9911793035be None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.082447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aad52-3698-4d21-b24a-9911793035be None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.083088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085aad52-3698-4d21-b24a-9911793035be None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.083088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 427/870] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:08.083209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 444/871] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:08.083287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aad52-3698-4d21-b24a-9911793035be None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.088920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.089193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.089473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.109682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:08.110871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:08.186308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 445/872] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:08.187449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.201852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085aad52-3698-4d21-b24a-9911793035be None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.215091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:08.221465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:08.241683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.242337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.242815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.243184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.243890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:08.244211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.246315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.259569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 428/873] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:08.264695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.298390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9a516-41ef-4c1c-923a-5feeeb56073b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.334670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.335702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.336202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.336588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.337371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.338745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.376094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613cf03-da44-4f6e-a3e5-7dc1304aff70 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.409061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 446/874] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:08 2022] POST /identity/v3/services => generated 269 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:08.409061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.420033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.420721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.421005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.421314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.422445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.423956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85011ee-2808-4798-8338-8d98c1a86d60 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.480009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 429/875] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:08 2022] POST /identity/v3/services => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:08.481491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf39f-223a-4e6a-8c54-a65687e8113d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.481783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf39f-223a-4e6a-8c54-a65687e8113d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.482063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bf39f-223a-4e6a-8c54-a65687e8113d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.483815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 430/876] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:08.489527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.489843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.490270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.513331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:08.515535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:08.536953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:08.540933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:08.557325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854aa90-3ebd-4f3d-a237-258ab554b11b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.611948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.612628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.617915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.618111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 431/877] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:08.618226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.618226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=f43a49de2754455795ab92ede9138eb2) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:08.618226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.618226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.624239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 447/878] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:08 2022] GET /identity/v3/role_assignments?user.id=f43a49de2754455795ab92ede9138eb2&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:08.639534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.758174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea8497-78ed-45eb-ad33-2843ee555a8f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.798961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.799791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.800075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.800352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.812333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:08.820663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:08.821685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:08.822501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 432/879] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:08.830263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:08.944328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce19a-f8a6-4fec-a1f3-30ef2f2884d9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:08.982800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:08.983481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:08.983767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:08.984044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:08.984802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:08.985143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:08.986523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:08.995489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 448/880] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:09.001343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:09.018288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:09.109607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030338d-be3c-4c50-a8f1-bcddc0eb5844 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:09.146132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:09.146928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:09.147210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:09.147487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:09.159623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:09.161064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:09.178373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:09.179244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:09.180537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:09.180537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:09.180537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:09.180537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:09.180537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 433/881] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:09.186367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:09.209755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:09.292873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c5cf28-e461-4eaa-a9f0-0f7f44062e27 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:09.330676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:09.331345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:09.331632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:09.331909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:09.332635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:09.332940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:09.334344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:09.347725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 449/882] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:09.354374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:09.420203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:09.463178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b782174-5b96-4ec5-8db5-3fc84bd17049 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:09.497840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615074-2849-427c-8990-9af53a722707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:09.498885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615074-2849-427c-8990-9af53a722707 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:09.499323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615074-2849-427c-8990-9af53a722707 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:09.499747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75615074-2849-427c-8990-9af53a722707 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:09.507425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75615074-2849-427c-8990-9af53a722707 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:09.508993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75615074-2849-427c-8990-9af53a722707 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-75615074-2849-427c-8990-9af53a722707 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:09.523957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:09.525097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:09.526251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:09.528549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 434/883] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:08:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:09.533979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:09.621443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:09.641609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99846803-41b7-4f96-af7f-8ef9dbba3cc1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:09.677349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:09.678051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:09.678318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:09.678598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:09.679466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:09.679777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:09.681237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:09.705809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 450/884] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:08:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:09.711068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615074-2849-427c-8990-9af53a722707 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:09.818400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75615074-2849-427c-8990-9af53a722707 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:09.847303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:09.859605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:09.860539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:09.860976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:09.861477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:09.933411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:09.936147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:10.080626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 435/885] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:09 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:10.086199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:10.250933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2684a6-7cf0-4f3d-a6a4-94de8fcaa44a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:10.289444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:10.303427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:10.304249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.304531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.304807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.332070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:10.334062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:10.355053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:10.356543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:10.357473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:10.357473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:10.357473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:10.357473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:10.364037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 451/886] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:10.369990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:10.422473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:10.530907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff1cf2-0308-4492-af5c-07b3e3c4c222 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:10.573969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:10.574782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.575461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.575461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.576067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:10.576377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:10.577772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9c684-a2c2-4114-b145-43de647965b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:10.594304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 436/887] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:10.599708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:10.711779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe5de-9363-4d08-aab8-58b277fa3c83 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.712422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe5de-9363-4d08-aab8-58b277fa3c83 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.712898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefe5de-9363-4d08-aab8-58b277fa3c83 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.714734 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 437/888] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:10.720410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade2b-3bc9-44ab-ba7f-f97679a9b87c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.720940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade2b-3bc9-44ab-ba7f-f97679a9b87c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.721433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bade2b-3bc9-44ab-ba7f-f97679a9b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.725414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee1024-cb0a-43bf-9c5b-174a4e657163 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:10.741922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f2bade2b-3bc9-44ab-ba7f-f97679a9b87c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:10.743599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f2bade2b-3bc9-44ab-ba7f-f97679a9b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:10.762427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:10.763321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.763622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.763899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.771358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:10.772963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:10.788401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:10.789357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:10.790222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 452/889] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:10.797359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:10.837044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 438/890] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:10.850628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0479-8a1c-4cb8-ae8f-d64183878e40 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.850913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0479-8a1c-4cb8-ae8f-d64183878e40 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.851213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f0479-8a1c-4cb8-ae8f-d64183878e40 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.851530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:10.853112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 439/891] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:10.854002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0479-8a1c-4cb8-ae8f-d64183878e40 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:10.870946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:10.913343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed688893-386c-4d1f-8aa8-acb2df380a18 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:10.947008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:10.947665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.947948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.948472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.949292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:10.949685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:10.951256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29bdd-55af-4679-a5da-523f9910a21e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:10.958101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f0479-8a1c-4cb8-ae8f-d64183878e40 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:10.963288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 453/892] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:10.964496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.964780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.965076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:10.981929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:10.983272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:10.997413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:10.998766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:10.999263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:10.999762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.000865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.002369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-fd17eab6-0cff-4a4d-8768-bba20d8c2ea3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:11.015466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:11.016394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:11.017244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 440/893] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 12 07:08:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:11.018326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80308f6-9f47-4275-8463-3651e555cfad None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.018326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80308f6-9f47-4275-8463-3651e555cfad None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.018326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80308f6-9f47-4275-8463-3651e555cfad None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.019754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 441/894] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:11.020250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80308f6-9f47-4275-8463-3651e555cfad None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.055217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 454/895] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:11.056269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.088400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.099740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.122223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80308f6-9f47-4275-8463-3651e555cfad None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.154723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.155365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.155667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.155948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.156106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff8e8-f2e1-47d2-8f5f-0377a8106675 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.156770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] RBAC: Adding query filter params (role.id=c6129fc497774150b71d7c0689422d0c, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=9fe24e20dfe24dc3904bd0b8831c1c7a) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.157105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.158511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1371bb-9e93-49ca-a738-475003fa74f5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.163795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 442/896] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/role_assignments?user.id=9fe24e20dfe24dc3904bd0b8831c1c7a&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=c6129fc497774150b71d7c0689422d0c => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.168494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.168494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.168494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.183750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:11.185008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:11.202795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.203759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.204048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.204329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.205083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.205399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.206791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.212175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 455/897] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.213971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.266226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 443/898] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:11.267080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.338738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.345712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5c68e-1094-43a9-934a-4bcd93b8d7fd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.349847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.379469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcee917-3272-4e6d-b9b5-059b47df957b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.382286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.382952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.383228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.383501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.384155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.385553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:11.398152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:11.399163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.400001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 456/899] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:11.401462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.423253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.424004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.424356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.424698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.425545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.425937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.427294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.433011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 444/900] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.433810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.513672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ba1df-7f3c-4dc0-aa4d-e24d7263fc1b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.542716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556f0f5-793e-446f-8bba-267d9cf4ffc7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.552514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.553650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.553761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.554002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.554672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.556110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:11.568984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:11.570006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:11.570827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 457/901] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:11.573879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.581253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.581921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.582228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.582483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.583194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.583499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.584847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.587041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.591357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 445/902] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.592053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.606137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.692377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ecb79-3ee0-4e9d-bd84-abc5ecd21175 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.702730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9fb42d-2a19-4e79-b838-e0633e3196f6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.730308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.731703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.732136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.732584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.733569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] RBAC: Adding query filter params (interface=public, service_id=024ea2669d4540ecbb54973402d158ad, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.734032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.735830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.738117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.738777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.739060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.739340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.740044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.740365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.741723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.742534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 458/903] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/endpoints?service_id=024ea2669d4540ecbb54973402d158ad&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.743463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.758759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 446/904] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.761801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.829941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.852519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:11.868619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f77039-987d-494e-b3d0-8ac1d39e9f27 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.868777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d626c-ed8a-4ac3-a840-ddc61e78aa92 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:11.905399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.906073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.906361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.906641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.907335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.908692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.909500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:11.910766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:11.911247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:11.911702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:11.912577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:11.913080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:11.914457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 447/905] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:08:11.914810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:11.915233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:11.930406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 459/906] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:11.937419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:12.054759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901dc5a7-c358-43d2-93de-83d81d8855f5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:12.088107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:12.089252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b4037-0da2-461e-b736-f2c5614d21c0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:12.098117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:12.102015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:12.102015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:12.102015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:12.102015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:12.102015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:12.102361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:12.109948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 448/907] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:12.134758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:12.135445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:12.135725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:12.135996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:12.136804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] RBAC: Adding query filter params (interface=public, service_id=60c559d8330a455ab721996d0d4b1fe9, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:12.137278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:12.138813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a806d-2cee-401c-8cee-58dff87a90fb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:12.146446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 460/908] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:08:11 2022] GET /identity/v3/endpoints?service_id=60c559d8330a455ab721996d0d4b1fe9&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:12.152058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:12.266833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66c9d3-48ee-44b8-8383-2f3eb8f62915 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:12.305049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:12.306106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:12.306594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:12.307075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:12.308071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:12.310215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f670c99-8583-40d0-a617-d19e7692da15 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:12.316854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 449/909] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:12 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:08:13.226749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ccf-dcc7-4da6-a347-2d4e38a63ab6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:13.227234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ccf-dcc7-4da6-a347-2d4e38a63ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:13.227234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee3ccf-dcc7-4da6-a347-2d4e38a63ab6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:13.228824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 461/910] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:13.234235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:13.234640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:13.234809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:13.251861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:13.253068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:13.309449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:13.327062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 450/911] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:13.348736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3ccf-dcc7-4da6-a347-2d4e38a63ab6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:13.365387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:13.462431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee3ccf-dcc7-4da6-a347-2d4e38a63ab6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:13.499624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:13.500366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:13.500655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:13.500931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:13.511981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:13.521310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:13.522249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:13.523095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 462/912] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:13.529187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:13.630980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e95f0-9b1f-4385-8b86-9479d3bcc786 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:13.666133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:13.666807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:13.667091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:13.667365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:13.668114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:13.668528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:13.669921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:13.678623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 451/913] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:13.684483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:13.767911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:13.793656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9fc4a5-a402-4642-be8c-1eb99d478d06 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:13.830302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:13.831114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:13.831399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:13.831686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:13.843201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:13.844668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:13.862422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:13.863380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:13.864631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:13.864631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:13.864631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:13.864631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:13.864631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 463/914] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:13.869258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:13.924534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:13.983140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4b366-7619-497f-a211-e7493567bc6d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.018220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.018807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.019091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.019367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.020097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:14.020403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.021790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaef2d2-9c96-4b78-9edc-617af11d964b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.035502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 452/915] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:14.040755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.109235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4167974-37e3-4ed4-947b-47954aebc443 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.109517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4167974-37e3-4ed4-947b-47954aebc443 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.110021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4167974-37e3-4ed4-947b-47954aebc443 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.111827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 453/916] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:14.117051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.117609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.118095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.138600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:14.139806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:14.156679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efb5a2-bbd0-4236-b2a3-a625df00fef3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.183663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.193061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.194187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.194616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.195034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.205176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.206883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:14.222917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:14.224084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:14.225083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:14.227476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 464/917] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:14.233113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 454/918] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:14.237965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.295430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.348979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c45825-8a87-4ae8-8e2b-007147dee173 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.363149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead27e26-9f8b-4ea2-b13a-346b084aaacf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.384209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.384884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.385187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.385468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.386295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:14.386601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.388262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ad2846-8518-46f9-94d5-379d09fe3aae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.400220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.401065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.401357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.401636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.402301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.404205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.406226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 465/919] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:14.407401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926373-003e-4e3f-8f65-3bed7d7727fb None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.407689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926373-003e-4e3f-8f65-3bed7d7727fb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.407965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81926373-003e-4e3f-8f65-3bed7d7727fb None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.413004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 466/920] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:14.413004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81926373-003e-4e3f-8f65-3bed7d7727fb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3b401969-e151-403b-adc7-688768f861c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:14.426389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:14.427536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 07:08:14.428536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:14.430804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 455/921] 10.222.0.27 () {56 vars in 1132 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:14.432150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.432581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.433003 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.451885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:14.453099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:14.462689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.517976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81926373-003e-4e3f-8f65-3bed7d7727fb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.519114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 456/922] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:14.519942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.550782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.563267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.564088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.564371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.564870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.574966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.576396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-40ce3f3a-4c89-4d7f-b244-5d7b2811bde1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:14.594771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:14.595689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:14.596571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:14.596571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:14.596571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:14.596571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:14.596571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 467/923] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:14.597927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005c24-34e3-43e2-8146-700d7780d6e6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.597927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005c24-34e3-43e2-8146-700d7780d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.597927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab005c24-34e3-43e2-8146-700d7780d6e6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.599096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 468/924] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:14.599638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab005c24-34e3-43e2-8146-700d7780d6e6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.624259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b2bd1-30ee-487b-a4d7-146c5392a108 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.658314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.658976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.659256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.659538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.660243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:14.660548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.661935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.666420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 457/925] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:14.667198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.694570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.701951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab005c24-34e3-43e2-8146-700d7780d6e6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.736797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.737483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.737771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.738051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.738772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.740134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.758314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:14.764333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8c986-ade2-4832-9835-457265acdd1b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:14.796849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:14.797524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.797806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.798078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.798797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:14.799096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:14.800426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c3d1-ad43-4c1c-803a-392d7198ad3a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:14.811246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 458/926] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:14.812317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:14.812598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:14.812871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:14.828630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:14.829812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:14.891039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 469/927] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:14 2022] POST /identity/v3/services => generated 241 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:14.891955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:14.905326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 459/928] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:14.905326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.002983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.021711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6011c72-f8c9-44f1-b5dd-0f6de16b98de None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.022280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599263d8-cb10-4f6f-9bf4-f3465127dc00 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.060613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.061386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.061652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.062484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.062604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:15.062920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.064294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.065832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.067149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.067593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.068260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.069920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 470/929] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:15.070844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.077396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.078880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:15.093946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:15.094892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:15.095800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 460/930] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:15.096276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.096348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.187039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c806d0d-c341-43ab-a442-916baa57eafd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.202449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41023d6c-602c-4e70-ba4c-06d5dca387c3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.223899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734177-3626-4781-a572-4410518cf13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.224700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734177-3626-4781-a572-4410518cf13c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.224979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734177-3626-4781-a572-4410518cf13c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.225295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7734177-3626-4781-a572-4410518cf13c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.226170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734177-3626-4781-a572-4410518cf13c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.227289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7734177-3626-4781-a572-4410518cf13c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b7734177-3626-4781-a572-4410518cf13c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:15.239746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:15.241188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:15.242087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 471/931] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:15.242873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734177-3626-4781-a572-4410518cf13c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.248022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.248685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.248967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.249269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.250013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.251365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.318742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.337068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 461/932] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:15.337068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.338533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.360850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7734177-3626-4781-a572-4410518cf13c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.420318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.421229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.421611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.422001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.422965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:15.423416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.425142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.438878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 472/933] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:15.444738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.469865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7315ee-6f8b-4997-93b7-efaf1e627783 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.511673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.513172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.513661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.513953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.515545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:15.515862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.517282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.524234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 462/934] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:15.531069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.575954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580205-33f5-4628-837d-7de410a3eeb1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.613876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.614879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.615269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.615632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/9fe24e20dfe24dc3904bd0b8831c1c7a/roles/c6129fc497774150b71d7c0689422d0c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.617573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.618715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=9fe24e20dfe24dc3904bd0b8831c1c7a, role_id=c6129fc497774150b71d7c0689422d0c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.620152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.658540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e0575-a1a1-4a41-8b39-cfe90387438a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.692457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:15.696113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.696847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.697168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.697455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.698486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:15.698800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.700999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7b8b8-c743-4fe8-8bd4-0ca5e7aff86f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.702581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 473/935] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:15 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/9fe24e20dfe24dc3904bd0b8831c1c7a/roles/c6129fc497774150b71d7c0689422d0c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:08:15.707159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 463/936] 10.222.0.27 () {56 vars in 1114 bytes} [Tue Jul 12 07:08:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:15.713158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:15.829410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14dc920-f2da-4d60-98bf-a667d1bab59e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:15.869077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:15.869754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:15.870043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:15.870323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:15.871152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:15.873128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dbb77c-7579-4e4b-b34a-0320f29a8ef9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:15.937421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 474/937] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:17.026087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497f0e-7e37-40ec-b87e-9b9a20efad33 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.027051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497f0e-7e37-40ec-b87e-9b9a20efad33 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.027575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4497f0e-7e37-40ec-b87e-9b9a20efad33 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.030626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 464/938] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:17.036075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.036917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.037436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.055004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:17.056514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:17.113850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:17.137424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 475/939] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:17.161708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4497f0e-7e37-40ec-b87e-9b9a20efad33 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.271443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4497f0e-7e37-40ec-b87e-9b9a20efad33 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.299301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:17.308439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.310428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.311305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.311305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.311688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.313083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-11d5a8f2-1c2c-4454-8612-2442888849bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:17.326957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:17.327975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.328844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 465/940] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:17.334769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.438467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf884a-bfc4-44b8-8d32-4ab5b42a124d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.438755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf884a-bfc4-44b8-8d32-4ab5b42a124d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.439223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf884a-bfc4-44b8-8d32-4ab5b42a124d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.440604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 466/941] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:17.443152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3256aaf3-5c1c-43d6-974b-67d26bed9754 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.446736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.447185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.447615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.469802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:17.471864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:17.482931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.483718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.484073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.484445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.485268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:17.485647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.487097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.492767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 476/942] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:17.499757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.553504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:17.577089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 467/943] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:17.593980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.625208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac837cc3-c1ba-45ad-865a-617090699ca0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.671412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.672285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.672632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.673282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.674493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:17.674896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.676975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.685066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 477/944] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:17.690477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.732426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfa15e-5183-4df1-ab0d-4c54bbc13606 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.758824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:17.777636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.779702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.780488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.780959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.781954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.784363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:17.802032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:17.803305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:17.804402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:17.806943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 468/945] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:17.813077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.824257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a24a0d-d5ba-4555-8822-b500bafbbce9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.839653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:17.870676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.871757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.872182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.873057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.874223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] RBAC: Adding query filter params (interface=public, service_id=8d29a84ed41e4fc596c5a71be1f76a0d, region_id=RegionOne) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:17.874652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.876754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a94d55a-2f48-42d6-a813-c911f6db497a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.884006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 478/946] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/endpoints?service_id=8d29a84ed41e4fc596c5a71be1f76a0d&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:17.885645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8044a-551c-40fd-8789-323acc56e897 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.885935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8044a-551c-40fd-8789-323acc56e897 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.886213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8044a-551c-40fd-8789-323acc56e897 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.888120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 479/947] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:17.892572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8044a-551c-40fd-8789-323acc56e897 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:17.940896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0c382-f1e8-4852-b9ed-46be2cf4c701 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:17.981994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:17.982669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.982951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.983225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:17.983935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:17.984240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:17.985614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f731440-fb22-4da3-bcbb-10a17e04cef5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:17.990401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 469/948] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:17.991582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e5eb-8bed-4e65-b159-80cbba53cef9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:17.991868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e5eb-8bed-4e65-b159-80cbba53cef9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:17.992146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681e5eb-8bed-4e65-b159-80cbba53cef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.008074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4681e5eb-8bed-4e65-b159-80cbba53cef9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:18.009270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4681e5eb-8bed-4e65-b159-80cbba53cef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:18.010903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8044a-551c-40fd-8789-323acc56e897 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.048994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.049689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.049979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.050255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.050938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.052298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.053806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.058268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 480/949] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:17 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:08:18.059446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.092169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 470/950] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:18.096342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5994-0d6e-4ef3-a29e-df6a67e8990c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.097193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5994-0d6e-4ef3-a29e-df6a67e8990c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.098161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb5994-0d6e-4ef3-a29e-df6a67e8990c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.104931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 471/951] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:18.107714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.108259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.108540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.119366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.128027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:18.133156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:18.195843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd5b2-adb4-4ccb-81a9-79daae0b0013 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.204481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 472/952] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:18.205692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.240335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.241859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.241859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.241859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.242417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:18.242724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.244098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.250827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 481/953] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:18.251613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.343189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5a03c-3d50-4e47-a2ac-6e32cff5eed9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.357893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.365633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51cc12-3c58-4c82-b935-345f2f888f9c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.368509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.398082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.398979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.399261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.399583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.408751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.409707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.409996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.410273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.410985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.412422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.412743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:18.414541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING keystone.server.flask.common [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:18.421730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:18.422727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:18.423584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 473/954] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:18.430063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.467939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.sql.core [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 07:08:18.467939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 07:08:18.467939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [parameters: {'id': '8c5d984e928b4e499ed14255686d20c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 07:08:18.467939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c5d984e928b4e499ed14255686d20c8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c5d984e928b4e499ed14255686d20c8. Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:08:18.477476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 07:08:18.478558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application yield resource Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise self.value Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application session.commit() Jul 12 07:08:18.479513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.flush() Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application compat.raise_( Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 07:08:18.480428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 07:08:18.483478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:08:18.484482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [parameters: {'id': '8c5d984e928b4e499ed14255686d20c8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.485616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:18.486639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c5d984e928b4e499ed14255686d20c8. Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 482/955] 10.222.0.27 () {60 vars in 1140 bytes} [Tue Jul 12 07:08:18 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:18.487889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.543761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c5c4b-6579-4f0d-9cd4-9415c52cab42 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.580009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.580848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.581298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.581716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.582577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:18.582980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.584435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.598521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 474/956] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:18.599481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.635701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.638136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fbcc6d-7d6a-4e98-9ba5-6d9a449deaf5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.684847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.687291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.687728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.688174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.698826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.701267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.714586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d879fbd-9907-4e68-9148-0868021cfb9e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:18.720864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:18.721976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:18.723203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:18.730480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 483/957] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:18.732039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.759446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.760260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.761163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.761578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.762147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.774103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.775778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:18.796336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:18.799465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:18.800384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:18.800384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:18.800384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:18.800384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:18.802863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 475/958] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:18.803789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:18.865949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13053df7-8302-43e3-89d6-a9de869c327d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.901540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.902366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.903251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.903638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.904726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:18.904848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.906646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:18.918949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:18.937267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 484/959] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:18.944815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46758eed-7597-4db8-9d2d-225719518877 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:18.988641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:18.989408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:18.989690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:18.989964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:18.990732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:18.991047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:18.992484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:19.007174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 476/960] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:19.013086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:19.103898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:19.130710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc23b4b-74d5-446d-8d56-dfe8ae1b3770 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:19.169969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:19.170780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:19.171061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:19.171335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:19.179236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:19.180674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:19.195488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:19.196561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:19.197586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 485/961] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:08:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:19.203369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:19.312237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3555c0-90d1-44cb-8c9d-0a01a9f85d84 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:19.349445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:19.350482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:19.350963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:19.351435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:19.352469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:19.352976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:19.354632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:19.370372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:19.375311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 477/962] 10.222.0.27 () {56 vars in 1149 bytes} [Tue Jul 12 07:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:19.382126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:19.495143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a6d46-aec1-4a8a-b4a8-39d04d4dafe2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:19.531469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:19.532118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:19.532399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:19.532673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:19.542541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:19.602727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:19.604182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:19.706164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 486/963] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:19.711846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:19.820390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1676ee-6a67-4272-acca-c941038630a4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:19.858832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:19.860083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:19.860579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:19.861114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:19.872735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:19.874473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:19.892786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:19.893760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:19.894654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:19.894654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:19.894654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:19.894654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:19.896843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 478/964] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:19.902788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:19.945986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.008456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784aca62-34c9-485f-a829-788d05eafffe None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.042723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.043904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.044182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.044454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.045200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:20.045506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.046863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c55b6-d87c-46e6-baa2-30c888c322eb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.059478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 487/965] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:20.065400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.124181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.174699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677a6c2-b8e7-4068-aa5f-47667af9508a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.210814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.211620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.211906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.212184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.213493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf739-353a-4343-8c94-f148d6a38e8b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.213870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf739-353a-4343-8c94-f148d6a38e8b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.214053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebf739-353a-4343-8c94-f148d6a38e8b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.219742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 488/966] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:20.219999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.221423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.221602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.221696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.221982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:20.237790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:20.238708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:20.239604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 479/967] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:20.242120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:20.244024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:20.244832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.333154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 489/968] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:20.350233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.352010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb2aaa1-0a38-4fc6-87b1-306bfae4692e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.381387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.385422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.393809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.394395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.394683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.394967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.395769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:20.396081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.397583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfc003-86f5-4da8-a688-5a859d85334e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.411163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 480/969] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:20.415416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff797-c5ff-4a1f-a5ad-4580c8054fc2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.415701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff797-c5ff-4a1f-a5ad-4580c8054fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.415993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cff797-c5ff-4a1f-a5ad-4580c8054fc2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.417381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 481/970] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:20.417985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff797-c5ff-4a1f-a5ad-4580c8054fc2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.466509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6529f8-79f7-42e7-a090-649fc8569561 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.501002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.501752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.502035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.502309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.502985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.504347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-7fed9d90-7f28-431f-9abd-38a918d4cc90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:20.516814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:20.517951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:20.518807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 490/971] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:20.519977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.519977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.519977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.537707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:20.538863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:20.541562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cff797-c5ff-4a1f-a5ad-4580c8054fc2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.578169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.578825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.579111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.579389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.580224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] RBAC: Adding query filter params (role.id=c6129fc497774150b71d7c0689422d0c, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=9fe24e20dfe24dc3904bd0b8831c1c7a) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:20.580538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.581992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.593345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 482/972] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/role_assignments?user.id=9fe24e20dfe24dc3904bd0b8831c1c7a&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=c6129fc497774150b71d7c0689422d0c => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:20.594116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.611314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 491/973] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:20.635540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.647041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.665855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.735237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ec408-e4f7-4408-9e87-3cd169e92dc5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.777256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165a708-670b-4319-85bf-39a4adf87e1c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.780606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.780606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.780825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.781053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.781809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:20.782124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.783492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.790477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 483/974] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:20.796646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:20.821957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.822186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.822281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.822758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.825068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.825691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:20.912678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:20.916415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d752fa-6b07-4414-a64f-e84611da8acf None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:20.933116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 492/975] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:20 2022] POST /identity/v3/services => generated 242 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:20.985326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:20.986650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:20.987140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:20.987689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:20.988770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:20.989316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:20.990995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf7458-17d3-4b1e-8028-4e6299cca830 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:21.003419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 484/976] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:21.005263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:21.103799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:21.125218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8cd561-f71b-4d1c-84e8-ce6c83c4750e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:21.163010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:21.164046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.164563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.165052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.166067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:21.167636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:21.199449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d04-d088-44cc-8e1d-4364530c9cc9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.199800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d04-d088-44cc-8e1d-4364530c9cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.200054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb90d04-d088-44cc-8e1d-4364530c9cc9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.201676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 485/977] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:21.206739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.217224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.217224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.224723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:21.225950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:21.245288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 493/978] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:21.318468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 486/979] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:21.345108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:21.457598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd296-6453-4978-9996-0923b28b7b81 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:21.493624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:21.494293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.494580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.494855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.495560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:21.497217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:21.507532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:21.534146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.sql.core [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 07:08:21.534146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 07:08:21.534146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [parameters: {'user_id': '0cdb6616882c49b29b7ee8e0645e1e03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 07:08:21.534146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80336) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:08:21.541764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:08:21.542627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application yield resource Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application next(self.gen) Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise self.value Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application session.commit() Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 07:08:21.544026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.session.flush() Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application compat.raise_( Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 07:08:21.545173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 07:08:21.546076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application conn.query(q) Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application result.read() Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 07:08:21.546901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [parameters: {'user_id': '0cdb6616882c49b29b7ee8e0645e1e03', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:21.547745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 07:08:21.550377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:21.552443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 494/980] 10.222.0.27 () {60 vars in 1131 bytes} [Tue Jul 12 07:08:21 2022] POST /identity/v3/users => generated 160 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:21.560363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:21.641604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:21.657554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e6fa45-41b0-4702-8ad6-6b3a2ec5bc25 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:21.693875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:21.694684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.694966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.695239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.703855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:21.705411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-e6822a29-5de9-43bb-b9c2-5b4998fe4c0d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:21.720589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:21.722813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:21.725303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 487/981] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:21.729178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:21.843590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915fc39-9e96-452a-97f6-e1cc797e5337 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:21.880704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:21.881748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:21.882217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:21.882670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:21.883734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:21.884253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:21.886105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a73651-f30c-4228-8e3a-da36cb5061b2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:21.926845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 495/982] 10.222.0.27 () {56 vars in 1101 bytes} [Tue Jul 12 07:08:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:22.695532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff20b6-1e2f-4a5a-83a8-ac86fad215e2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:22.696076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff20b6-1e2f-4a5a-83a8-ac86fad215e2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:22.696076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff20b6-1e2f-4a5a-83a8-ac86fad215e2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:22.697639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 488/983] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:22.703208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:22.703624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:22.703809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:22.721500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:22.722988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:22.779425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:22.792762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 496/984] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:22.815641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff20b6-1e2f-4a5a-83a8-ac86fad215e2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:22.919490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff20b6-1e2f-4a5a-83a8-ac86fad215e2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:22.958875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:22.959596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:22.959880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:22.960152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] PATH_INFO: `/v3/services/image` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:22.960805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:22.962192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0bfda39e-1700-49b1-88b6-5cb4883efc92 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:22.974984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:22.975963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:22.976801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:22.981246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 489/985] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 12 07:08:22 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:22.982323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.053223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407af4-3acf-4da6-9b89-955d50ce4b21 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.053522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407af4-3acf-4da6-9b89-955d50ce4b21 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.053806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b407af4-3acf-4da6-9b89-955d50ce4b21 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.055308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 490/986] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:23.060436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.060731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.061011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.079689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:23.081187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:23.084045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.086066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2964d-a4dc-49eb-8860-4f3b4aa0911a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.122062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.122727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.123012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.123286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.123989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] RBAC: Adding query filter params (name=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.124290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.125672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.130508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 497/987] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:23.135906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.160085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 491/988] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:23.182110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.193880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.244519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f588f-3cca-469f-9997-d74bd9b13d2d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.281564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.282227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.282506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.282779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.283480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.283785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.284859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc6b8-7e4f-4b91-a9c6-66096744e084 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.285164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.290888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 498/989] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:23.322224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.323037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.323568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.323836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.324547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.325982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9066900e-3647-4861-8bf4-02c6f3f76432 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:23.338601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:23.339722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:23.342401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:23.345405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 492/990] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:23.347201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.407689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184039a-90c3-4441-852e-108689103d01 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.407974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184039a-90c3-4441-852e-108689103d01 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.408256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184039a-90c3-4441-852e-108689103d01 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.409839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 493/991] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:23.415413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.415703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.415982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.423585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.435334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:23.436637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:23.468001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd3ca7-0d94-40a1-b96f-b56d424e068d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.485747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.504609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.505589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.505864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.506137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.506928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.507136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.508487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.513680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 494/992] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:23.514442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 499/993] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:23.522532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.537008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.630732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fb77be-5e21-4833-af34-7dcefe382391 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.655469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005321f-f7e8-41d1-a9bd-4d8453325429 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.671506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.672422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.672797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.673164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.674078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.674418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.675874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.677230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.681343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 495/994] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:23.687488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.700122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.700979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.701304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.701583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.702237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.703617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:23.716350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:23.717643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:23.718649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 500/995] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:23.723808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.774446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.805683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694fe74e-9ff9-49e2-857f-d7c01453ee38 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.833191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2477bf-1fe7-4afc-879c-a8c338b9b82d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:23.844946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.846127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.846573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.847232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.848655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] RBAC: Adding query filter params (interface=public, service_id=22a04e4f9e2a42848dab301f072a7587, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.849149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.850797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.859092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 496/996] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/endpoints?service_id=22a04e4f9e2a42848dab301f072a7587&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:23.864321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.872320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:23.872988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:23.873301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:23.873580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:23.874354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:23.874670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:23.876146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:23.885487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 501/997] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:23.886471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:23.935172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:23.975103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549863d7-7f54-43cf-843b-20719d933258 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:24.003610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce493eb-c32a-4af6-b3cb-b5d2dd57c9bd None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:24.011324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:24.012025 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:24.012311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:24.012590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:24.013309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:24.013718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:24.015066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:24.022081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 497/998] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:08:24.042120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:24.042845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:24.044258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:24.044815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:24.045936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:24.046773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:24.048185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:24.059368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 502/999] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:24.060629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:24.171739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f22299-222a-4884-ab1b-7616217e731b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:24.202136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:24.210671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] RBAC: Adding query filter params (interface=admin, service_id=8d29a84ed41e4fc596c5a71be1f76a0d, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:24.217201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364fca7-04f0-4e42-90fa-d85b782bfe32 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:24.220244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 498/1000] 10.222.0.27 () {56 vars in 1249 bytes} [Tue Jul 12 07:08:24 2022] GET /identity/v3/endpoints?service_id=8d29a84ed41e4fc596c5a71be1f76a0d&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:24.225854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:24.328093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6313e-df16-4a79-9c57-71aba4ceb552 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:24.361780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:24.362441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:24.362721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:24.362994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:24.363663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:24.365072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e217c-5276-48ef-b1ea-c4fa29d4d5ab None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:24.372095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 503/1001] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:24 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:08:25.348030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276eae-1547-4e31-a8c8-b3c070451fe0 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:25.348530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276eae-1547-4e31-a8c8-b3c070451fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:25.348530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2276eae-1547-4e31-a8c8-b3c070451fe0 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:25.349943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 499/1002] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:25.355000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684733c7-a99b-44b7-adc1-6667cae047c0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:25.356130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684733c7-a99b-44b7-adc1-6667cae047c0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:25.356130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684733c7-a99b-44b7-adc1-6667cae047c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:25.372963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-684733c7-a99b-44b7-adc1-6667cae047c0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:25.374168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-684733c7-a99b-44b7-adc1-6667cae047c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:25.403421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:25.442145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 504/1003] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:25.464634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276eae-1547-4e31-a8c8-b3c070451fe0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:25.572817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2276eae-1547-4e31-a8c8-b3c070451fe0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:25.607086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:25.607676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:25.607957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:25.608229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:25.608959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:25.610349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909c6f6-4b57-4d55-b4d7-b86911452920 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:25.681055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 500/1004] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:25 2022] POST /identity/v3/services => generated 242 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:26.085781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39750-7008-4dc8-9d6d-e848fb1aa3a9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.086123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39750-7008-4dc8-9d6d-e848fb1aa3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.086347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff39750-7008-4dc8-9d6d-e848fb1aa3a9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.087893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 505/1005] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:26.093248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.093550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.093835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.111553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:26.112746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:26.161817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:26.190775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 501/1006] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:26 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:26.214364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff39750-7008-4dc8-9d6d-e848fb1aa3a9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.323477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff39750-7008-4dc8-9d6d-e848fb1aa3a9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.358532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.359352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.359613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.359893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.360554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.361954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4716e564-6441-4912-ae78-003b88fa2182 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:26.374700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:26.375726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 07:08:26.376575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.378008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 506/1007] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:26.381909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.405818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c543ae-e60f-4efd-a473-dad6e0caec94 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.406131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c543ae-e60f-4efd-a473-dad6e0caec94 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.406374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c543ae-e60f-4efd-a473-dad6e0caec94 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.407744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 507/1008] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:26.412496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.412781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.413081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.430210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:26.431375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:26.459352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:26.487277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42724903-11ad-4f5d-b17d-719d7ec60f86 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.509349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 508/1009] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:26 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:26.521202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.521871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.522153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.522427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.523222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:26.523535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.524900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:26.525817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.531206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 502/1010] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:26.536675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.583214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:26.636208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea02f1-e1e0-4c9a-9d07-d71d263c736b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.647555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674528b-8daa-487d-9910-b940e6d2ee8e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.680382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.681768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.682261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.682770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.683474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.684857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:26.685882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.686546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.686838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.687116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.687923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:26.688232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.689624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:26.694659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 503/1011] 10.222.0.27 () {56 vars in 1112 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:26.700290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:26.701500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 07:08:26.702371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:26.703133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.705308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 509/1012] 10.222.0.27 () {56 vars in 1126 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:26.708273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.742257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:26.838700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f35b8-35ca-4341-ac93-8aa4effe1ba5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.847833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467412f3-8ec6-46cd-9530-ce4aa09da358 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:26.852507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:26.885875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.886571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.887374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.887647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.888401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:26.888702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.890168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:26.895290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 510/1013] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:26.901394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:26.904283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:26.904954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:26.905272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:26.905814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:26.906579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:26.908937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:27.000512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:27.011412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 504/1014] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:26 2022] POST /identity/v3/endpoints => generated 334 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:08:27.013453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9b3fd-d532-4bcc-9246-2f8c20c47c03 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:27.067395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:27.068086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:27.068373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:27.068649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:27.069419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:27.069731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:27.071167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96bf3ff-551b-4a02-b88d-9076b0943711 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:27.083123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 511/1015] 10.222.0.27 () {56 vars in 1122 bytes} [Tue Jul 12 07:08:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:27.084149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:27.205377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1a3ca-d110-41f7-84d5-84f1c6894d2e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:27.247733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:27.248400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:27.248679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:27.248953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:27.249722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:27.251188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d3179-fb21-4bbe-8647-e3288fb556e3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:27.332512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 505/1016] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:27.748629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555566-3a07-46f1-9a48-b942643cc9ef None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:27.749197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555566-3a07-46f1-9a48-b942643cc9ef None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:27.749197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555566-3a07-46f1-9a48-b942643cc9ef None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:27.750741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 512/1017] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:27.755640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:27.756024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:27.756207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:27.773965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:27.775158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:27.789943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:27.851385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 506/1018] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:27.875753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555566-3a07-46f1-9a48-b942643cc9ef None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:27.984513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57555566-3a07-46f1-9a48-b942643cc9ef None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:28.019830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:28.020553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:28.020839 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:28.021146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] PATH_INFO: `/v3/services/image` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:28.021804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:28.023162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:28.034740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:28.035737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:28.041943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 513/1019] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 12 07:08:27 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:28.042881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:28.141370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72acd6-58f7-4955-a4eb-bec32622b3f4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:28.175134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:28.175793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:28.176080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:28.176355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:28.177086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] RBAC: Adding query filter params (name=image) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:28.177400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:28.178750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:28.188581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 507/1020] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:28.190082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:28.206160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:28.296133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cb893-5c9a-4da2-9f1c-9cc0fe2b0d4c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:28.330569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:28.331240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:28.331525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:28.331801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:28.332504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:28.332809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:28.334190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:28.341182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 514/1021] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:28.345339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:28.358780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:28.446412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89db764-0f37-4156-a2da-ac2df23eac40 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:28.482423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:28.483080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:28.483363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:28.483637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:28.484429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] RBAC: Adding query filter params (interface=public, service_id=25d33a69c15643e3b35b7a2ff9ae5534, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:28.484740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:28.486123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2058bb-f2c0-4ee8-931f-44921c02c97f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:28.495934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 508/1022] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:08:28 2022] GET /identity/v3/endpoints?service_id=25d33a69c15643e3b35b7a2ff9ae5534&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:28.497493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:28.575735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:28.598780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb20bb7b-16ea-49a8-a6b1-18b45329030b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:28.634208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:28.634875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:28.635158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:28.635433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:28.636114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:28.637808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49302c9a-915a-408f-a5dc-896652d8182a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:28.644585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 515/1023] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:08:28 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:08:29.184281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570f36a-e25d-430b-8b92-a5116ecba247 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.184825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570f36a-e25d-430b-8b92-a5116ecba247 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.184825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570f36a-e25d-430b-8b92-a5116ecba247 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.186356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 509/1024] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:29.191336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36169a-2000-4ef2-b73f-bc7482e000cb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.191712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36169a-2000-4ef2-b73f-bc7482e000cb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.191903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36169a-2000-4ef2-b73f-bc7482e000cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.208972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ac36169a-2000-4ef2-b73f-bc7482e000cb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:29.210162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ac36169a-2000-4ef2-b73f-bc7482e000cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:29.279212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 516/1025] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:29.302473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570f36a-e25d-430b-8b92-a5116ecba247 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.380051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:29.400835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371feb-32f4-4611-87a8-aba36b06eea0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.401152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371feb-32f4-4611-87a8-aba36b06eea0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.401425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371feb-32f4-4611-87a8-aba36b06eea0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.403690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 517/1026] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:29.407779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570f36a-e25d-430b-8b92-a5116ecba247 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.408723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.409005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.409333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.427411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:29.428587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:29.445088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.445955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.446270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.446544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.458817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:29.467677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:29.468670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:29.469678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:29.473648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 510/1027] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:29.474844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.494871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:29.500441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 518/1028] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:29.523932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.591168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135f83e-2f16-4489-bd1a-665fffcf9259 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.626482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.627149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.627475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.627695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.628444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:29.628747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:29.630126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:29.631033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd5728-3241-4f8e-a3f5-04386fabe7d1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.631693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:29.644900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 511/1029] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:29.645949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.671528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.672330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.672606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.672873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.674488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:29.675915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:29.683135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 519/1030] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:29.684507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.754039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:29.774763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca5a05-2e73-4606-b61a-5fe607e2d30d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.796053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f978c33-70e1-406e-a19f-1150099fbd80 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.812495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.813419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.813705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.813984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.825041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:29.826499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:29.832693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.833759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:29.834187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:29.834605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:29.835578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:29.836994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:29.844775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:29.845899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:29.846884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:29.846884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:29.846884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:29.846884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:29.846884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 512/1031] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:29.851520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:29.899744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:29.920661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 520/1032] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:29 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:29.959290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad64f29-8996-453b-b593-87d0573b0d00 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:29.999172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:29.999856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.000135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.000411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.001173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:30.001484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.002879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.020206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 513/1033] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:30.021457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.128000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea94c9d-802b-4b3e-9783-b83aff04d276 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.148389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:30.163261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:30.164131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.164410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.164681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.171969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.173477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:30.188585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:30.189847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:30.190817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 521/1034] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:30.198027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.305745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95cc0f-aa8a-483e-89e8-6394b92ffec7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.315711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:30.341871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:30.342553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.342840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.343117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.343965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:30.344281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.345764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.369053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 514/1035] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:30.370394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.473547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a217f8-14de-43bd-83df-aae392e96f17 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.508917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:30.509591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.509872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.510148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.558821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:30.578820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.580473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e6a94-6fae-4fbf-9119-4611de208855 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.685780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 522/1036] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:30.687325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.692666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-6164-4b7a-85b7-603d59286d8a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.692961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-6164-4b7a-85b7-603d59286d8a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.698404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fd291-6164-4b7a-85b7-603d59286d8a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.698404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 523/1037] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:30.700203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.700769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.700769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.717420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:30.718600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:30.791499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 524/1038] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:30.798694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d202806-b55f-4635-be72-e2ed4574bcd0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.814666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.827834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:30.835982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:30.836778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.837141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.837568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.848687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.850203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:30.868484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:30.869597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:30.870673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:30.870673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:30.870673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:30.870673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:30.872980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 515/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:30.878425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:30.897601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:30.928436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fed8b3-dca4-4c90-bcc5-4c7aca30973b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.972240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:30.973194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:30.973355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:30.973656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] PATH_INFO: `/v3/services/image` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:30.974324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:30.975722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:30.987716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:30.988729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:30.989655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 525/1040] 10.222.0.27 () {56 vars in 1105 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:30.994439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a944d-f262-4211-9ed7-371715cf9d2f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:30.994663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.032988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.033685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.033972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.034252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.034982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:31.035292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.037136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.051712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 516/1041] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:31.057521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.074963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:31.101174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ad5f2-4ce5-4f1a-abb6-7951f76ba090 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.138371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9447-956e-4086-ab70-486282e678bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.139165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9447-956e-4086-ab70-486282e678bf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.139509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9447-956e-4086-ab70-486282e678bf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.139847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f9447-956e-4086-ab70-486282e678bf None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.141078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9447-956e-4086-ab70-486282e678bf None admin] RBAC: Adding query filter params (name=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:31.141392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9447-956e-4086-ab70-486282e678bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.143120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f9447-956e-4086-ab70-486282e678bf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.143980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:31.153097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 526/1042] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:31.154255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9447-956e-4086-ab70-486282e678bf None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.173440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdff79a-c810-424f-9934-e57c4997cf14 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.209826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.210714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.211062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.211346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.218755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.220181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:31.235042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:31.235988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:31.236909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:31.241073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 517/1043] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:31.241881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.263433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f9447-956e-4086-ab70-486282e678bf None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.299964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.300666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.300954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.301257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.302147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:31.302483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.303830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.313713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 527/1044] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:31.314707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.317226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:31.348070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e784-8643-4154-afa5-f4ef89cf0826 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.384442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.385129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.385416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.385696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.386480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:31.387575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.388987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.395716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:31.401636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 518/1045] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:31.407873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:31.422680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf60ef2-3694-4518-b40e-413df4239bf4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.463072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.463944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.464075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.464279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.465267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.466631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7101a3-7b98-4d62-a843-d990f81e1b72 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.514940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54910ed3-d8ab-4a2a-9478-ad97c28d6cf6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:31.546470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 528/1046] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:08:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:08:31.564505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:31.565237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.565505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.565786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.566644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] RBAC: Adding query filter params (role.id=c6129fc497774150b71d7c0689422d0c, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:31.566963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:31.568471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5dd20-0d90-45dd-b303-8492aae5c703 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:31.575935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 519/1047] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:31 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=c6129fc497774150b71d7c0689422d0c => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:31.997654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac23e9-7c21-44b5-8647-2861c5540f81 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:31.997959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac23e9-7c21-44b5-8647-2861c5540f81 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:31.998223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bac23e9-7c21-44b5-8647-2861c5540f81 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:31.999741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 529/1048] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:32.004714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:32.005008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:32.005314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:32.022417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:32.023592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:32.079514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:32.093218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 520/1049] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:32.117301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac23e9-7c21-44b5-8647-2861c5540f81 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:32.178124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:32.222049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bac23e9-7c21-44b5-8647-2861c5540f81 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:32.258501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:32.259320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:32.259600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:32.259868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:32.261056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:32.264142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00b81b-3132-4a83-ba9b-8a905de70f15 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:32.265991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 530/1050] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:32.271445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:32.371503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41764cd-f29a-458d-b76c-f4b25151447a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:32.405175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:32.405837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:32.406121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:32.406390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:32.407100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:32.408505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c1f4a-ce13-4271-a3eb-b33199d6bdf7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:32.506358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 521/1051] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:08:32 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:33.612741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9961-5e69-474f-8cb6-1f5ce63074e6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.613296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9961-5e69-474f-8cb6-1f5ce63074e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.613376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb9961-5e69-474f-8cb6-1f5ce63074e6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.614863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 531/1052] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:33.620052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.620441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.620690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.638107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:33.639310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:33.648133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be342-6a8e-4b67-bd63-772e00c60a2a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.648422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be342-6a8e-4b67-bd63-772e00c60a2a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.648702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016be342-6a8e-4b67-bd63-772e00c60a2a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.650268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 532/1053] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:33.656397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.656760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.656966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.674513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:33.675703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:33.685487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:33.714695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 522/1054] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:33.737747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:33.750430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 533/1055] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:33.772648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:33.832426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:33.847051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55467203-5a0c-4330-9dba-8d5e44a1b390 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:33.882014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93d82a-98bf-4757-a830-8b95414527b5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:33.883007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:33.883824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.884108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.884963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.895814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:33.905222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:33.906149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:33.907001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 523/1056] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:33.912430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:33.921487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:33.922596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:33.922888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:33.923168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:33.948069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.004691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.006495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.023659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e684494-485d-44ec-8e09-94fca2d6a3c6 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.060302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.060979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.061298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.061585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.062337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:34.062648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.064020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.068105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.077046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 524/1057] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:34.078374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.116310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 534/1058] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 07:08:34.122937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.179408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.186082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681db37b-b82f-4257-a3b2-0e00ecf1bf16 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.222101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.222902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.223185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.223462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.235175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.236617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.236787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a689b-a729-4615-8cba-97a32ee4d7a0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:34.256341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:34.257360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:34.258312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:34.258312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:34.258312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.258312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:34.262816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 525/1059] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:34.263456 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.278656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.279464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.279866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.280148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.293405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.294949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:34.313292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:34.314443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:34.315575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:34.315575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:34.315575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.315575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:34.315575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 535/1060] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:34.320193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.331841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.378877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd347c-e217-494b-9359-a673de9c2aac None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.415351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.416010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.416298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.416576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.417333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:34.417646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.419042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.427491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b615535c-83ca-47c3-b452-f852866c267d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.431765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 526/1061] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:34.437677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.448027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.468360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.469052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.469346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.469651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.470389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:34.470698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.472067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f407-6af7-43a5-ad1b-3f9ff26f3af2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.493065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 536/1062] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:34.555738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb91f20-5c70-47d5-a732-4b1aaabd3d34 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.593625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.594439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.594721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.594992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.601353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f610-6295-4515-b11f-996a648c68e8 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.601665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f610-6295-4515-b11f-996a648c68e8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.601926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56f610-6295-4515-b11f-996a648c68e8 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.603501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 537/1063] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:34.603690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.605931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.609745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.610040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.610370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:34.622956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:34.624331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:34.625374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:34.629067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 527/1064] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:34.629929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:34.630417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.630569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:34.709489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.711324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.717364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 538/1065] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:34.741324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.745645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce32e-dba7-498f-8a34-e101cc35d9d8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.785581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.786254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.786537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.786815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.787719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:34.788028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.789564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.806632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 528/1066] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:34.812728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.849552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e2447-d694-4fed-9d4f-52215f565ff3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.883352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.884175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.884463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.884743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.895676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:34.903469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:34.904395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:34.905250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 539/1067] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:34.910512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:34.912625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be770e-2613-40f4-9078-4b94b6aeff47 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:34.938507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.947503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:34.949126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:34.949422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:34.949792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:34.960112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:34.961706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:34.973237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:34.979899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:34.990020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 529/1068] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:34.990952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.016998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13fb73-d44e-4cb6-bb6b-3cde7d20bd90 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.050254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.050916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.051200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.051484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.052227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:35.052539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.053927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.062686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 540/1069] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:35.068274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.086529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbda66-888b-4060-880e-ebf32141f8dd None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.120961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.121645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.121925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.122198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.122929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:35.123236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.124586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.136278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 530/1070] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:35.142589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.171783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7222-6b19-4a77-873d-4281464ea279 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.182727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.193365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.207411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.208267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.208542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.208805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] PATH_INFO: `/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.222873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] RBAC: Authorizing `identity:get_user(user_id=b42e4db81f3d4bbbb5916fd5dfb6e835)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.223709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.225603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 541/1071] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:35.230949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.242347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530bb81-76c1-4bd2-9417-613450b7a961 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.276264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.277137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.277426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.277741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.284279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.285737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:35.300026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:35.301124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:35.302133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 531/1072] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:35.306836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.331136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84bbb2-7c83-4b4f-9baf-9261c630d9c1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.364051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.364701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.364990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.365300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.400622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.404921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffa6b0-b5f5-4dbb-b5d4-dad3f5fb6da8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.409853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.430615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.432162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.437988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.438641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.438925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.439199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.439988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:35.440306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.441739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.454037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 532/1073] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:35.459894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.533603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 542/1074] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 07:08:35.539411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.561705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c61fa-ce07-4cbb-a295-27ebdb9cbb9e None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.595320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.596211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.596498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.596781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/c6129fc497774150b71d7c0689422d0c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.599052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=1bd3f89d420e4418babdbac8736d8fa5, role_id=c6129fc497774150b71d7c0689422d0c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.600478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.615798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.636028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca21c-c1e4-4206-bdeb-ab1b9e2f3444 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.669923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.670758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.671037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.671309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.672421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 533/1075] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:35 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/1bd3f89d420e4418babdbac8736d8fa5/roles/c6129fc497774150b71d7c0689422d0c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:08:35.672881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.673955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50403f80-ab59-435c-a4c3-f42933d0292e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.675841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 543/1076] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:35.682175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:35.704457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:35.797154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f41b0e-990f-4965-a405-31e4e8394356 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:35.834580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:35.835238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:35.835524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:35.835807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:35.836649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=c95acf8640eb4427826a2efdb9b4b50a, user.id=b42e4db81f3d4bbbb5916fd5dfb6e835) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:35.836991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:35.838448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779e3919-9c7b-4567-ac6d-f78a7af74eff None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:35.844012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 534/1077] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:35 2022] GET /identity/v3/role_assignments?user.id=b42e4db81f3d4bbbb5916fd5dfb6e835&scope.project.id=c95acf8640eb4427826a2efdb9b4b50a&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:37.689557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32293e9-82f8-4399-8b1f-3dca8895ab8c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:37.690089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32293e9-82f8-4399-8b1f-3dca8895ab8c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:37.690089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32293e9-82f8-4399-8b1f-3dca8895ab8c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:37.691498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 544/1078] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:37.696810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b65b-6f51-4b5c-99f6-3858270a42f4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:37.697266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b65b-6f51-4b5c-99f6-3858270a42f4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:37.697398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288b65b-6f51-4b5c-99f6-3858270a42f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:37.715027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5288b65b-6f51-4b5c-99f6-3858270a42f4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:37.716427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5288b65b-6f51-4b5c-99f6-3858270a42f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:37.783251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 535/1079] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:37.807377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32293e9-82f8-4399-8b1f-3dca8895ab8c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:37.842643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3115f-75b4-408b-909d-60a7ac2674c3 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:37.843101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3115f-75b4-408b-909d-60a7ac2674c3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:37.843384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3115f-75b4-408b-909d-60a7ac2674c3 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:37.845556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 536/1080] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:08:37.850379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:37.850664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:37.851245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:37.867060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:37.868228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:37.875870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:37.911424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32293e9-82f8-4399-8b1f-3dca8895ab8c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:37.936967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 537/1081] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 07:08:37.944727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:37.945499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:37.945785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:37.946060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:37.958290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:37.960643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:37.967073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:37.968022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:37.968859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 545/1082] 10.222.0.27 () {56 vars in 1120 bytes} [Tue Jul 12 07:08:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:37.974619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:37.984813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.061546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effa224a-5d10-4ae1-a00b-1a2fb9f975a3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.075641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a94c11-c6ee-46c0-98fb-d76d44d85d8e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.094083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.094871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.095152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.095431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.105932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:38.109559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.110219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.110507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.110786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.111532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:38.111841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.113233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:38.113590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:38.114653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:38.115619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 538/1083] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:38.120751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.126595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 546/1084] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:08:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.126736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.127541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.190677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.220216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064df83-c012-45b7-9591-f5eb68240d40 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.223668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f099891-b2d3-4e92-86a2-3aa60d0461ec None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.253604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.254261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.254545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.254819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.255565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:38.255871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.256818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.257247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.257630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.257911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.258184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.266135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 539/1085] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.270563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.271877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.271995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:38.289959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:38.290890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:38.291768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:38.291768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:38.291768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:38.291768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:38.291768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 547/1086] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:38.297333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.335217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.373444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42884dd3-d389-4936-9f30-76ed2e34fe2c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.393423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a0aeb-952d-4874-a89b-52e52d514960 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.406990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.407859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.408137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.408409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] PATH_INFO: `/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.409606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] RBAC: Authorizing `identity:get_user(user_id=b42e4db81f3d4bbbb5916fd5dfb6e835)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.411030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.412645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 540/1087] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.413348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.418656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.428992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.429680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.429961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.430231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.430948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:38.431249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.432594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.449059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 548/1088] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.451022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.518079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6126e-92f7-4110-a568-cc033e23fc74 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.546315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.548686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb431115-5ec1-4e9a-9eeb-0631645a10bb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.551491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.552350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.552636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.553008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.554189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.567650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.567650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 541/1089] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.567650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.583442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.584225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.584503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.584790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.591819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.593293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:08:38.607326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:38.608277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:38.609253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 549/1090] 10.222.0.27 () {56 vars in 1093 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:08:38.614021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.655208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.667036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b8aa2-617f-450d-8b7a-445cd1acb4a2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.701529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.702413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.702693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.702966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a/users/b42e4db81f3d4bbbb5916fd5dfb6e835/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.704938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] RBAC: Authorizing `identity:create_grant(project_id=c95acf8640eb4427826a2efdb9b4b50a, user_id=b42e4db81f3d4bbbb5916fd5dfb6e835, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.706390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.713081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d1377-f719-43f4-8e7c-30794a9a5b8b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.748465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.749166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.749454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.749730 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:38.750559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:38.750869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:38.752380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:38.770927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 550/1091] 10.222.0.27 () {56 vars in 1133 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:08:38.776522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:38.780357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 542/1092] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:38 2022] PUT /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a/users/b42e4db81f3d4bbbb5916fd5dfb6e835/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:08:38.918608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:38.924204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8cd1b-97e6-4460-aa9c-9a2038d718e0 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:38.959457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:38.960165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:38.960447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:38.960719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.027793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.029180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.120127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:39.125331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 551/1093] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 07:08:39.131197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:39.190312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:39.232669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a45345-76ce-4027-bfbf-601642e9755d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:39.267245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:39.268035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:39.268318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:39.268594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.279077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.280445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:08:39.297202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:39.298268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:39.299567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:08:39.299567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:08:39.299567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:08:39.299567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:39.299567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 543/1094] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:39.304030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:39.400811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997911d2-9326-4eb8-b120-b9fb54d2c778 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:39.433968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:39.434627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:39.434909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:39.435184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.435906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:39.436211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.437606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.449549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 552/1095] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:39.455051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:39.556324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ffb95-3f19-4bde-9be3-f183aae48a44 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:39.568833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:39.589943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:39.590740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:39.591022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:39.591296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.597734 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.599163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:08:39.614213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:39.615146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:08:39.616264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 544/1096] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:39.621746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:39.679237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:39.720816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59f903-7473-4a42-9bce-d783072ffed3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:39.754132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:39.754784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:39.755070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:39.755347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.756131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:39.756444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.757906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c60d4-7d9f-4d2f-ad0a-c653338294a0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.769764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 553/1097] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:39.775758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:39.876725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e7c4e-106c-4d95-8667-d4ad88d7e45c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:39.910346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:39.910994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:39.911278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:39.911555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:39.912382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] RBAC: Adding query filter params (role.id=c6129fc497774150b71d7c0689422d0c, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=1bd3f89d420e4418babdbac8736d8fa5) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:39.912695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:39.914147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d560c142-645b-4a4f-8e02-407a272bd8e7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:39.920437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 545/1098] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:39 2022] GET /identity/v3/role_assignments?user.id=1bd3f89d420e4418babdbac8736d8fa5&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=c6129fc497774150b71d7c0689422d0c => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:40.780346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4c461-16b9-44da-8375-a7ba1864a128 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:40.780871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4c461-16b9-44da-8375-a7ba1864a128 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:40.780959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4c461-16b9-44da-8375-a7ba1864a128 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:40.782318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 554/1099] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:40.787552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:40.787966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:40.788105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:40.804910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:40.806094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:40.834081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:40.871501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 546/1100] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:40.895003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4c461-16b9-44da-8375-a7ba1864a128 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:40.996203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4c461-16b9-44da-8375-a7ba1864a128 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.013762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:41.030139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.031082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.031314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.031582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.041126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:08:41.049827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:08:41.050945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:08:41.051976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 555/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:08:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:08:41.056978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:41.155158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3e649-f555-43bb-b2cf-5a100a016a78 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.188061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.188716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.188998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.189305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.190049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:41.190355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:41.191708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:41.200474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 547/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:41.206094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:41.302199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940c27-6826-409a-9ef8-579268ff71ff None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.334463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.335313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.335596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.335871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] PATH_INFO: `/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.337072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] RBAC: Authorizing `identity:get_user(user_id=b42e4db81f3d4bbbb5916fd5dfb6e835)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:41.338486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:41.340680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 556/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:41 2022] GET /identity/v3/users/b42e4db81f3d4bbbb5916fd5dfb6e835 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:41.346236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:41.374459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:41.443067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb83b24-5268-4a72-862f-02078d3ebc33 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.475653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.476283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.476573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.476849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.541415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:41.542879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:41.568808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:41.638798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 548/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:41.644623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:41.691111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:41.742900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71d640-0e4b-4727-b39a-3d12c2fb79ba None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.775225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.776070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.776353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.776631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.778050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:41.779470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df562aeb-6858-4a9c-9439-300bbc842cbf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:41.781172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 557/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:41 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:41.787100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:41.882255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1507124-7ece-4a80-8942-3f6b46d45bb7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:41.907110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:41.914439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:41.917368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:41.917368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:41.917368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:41.917368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=c95acf8640eb4427826a2efdb9b4b50a, user.id=b42e4db81f3d4bbbb5916fd5dfb6e835) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:41.917368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:41.918908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd61dff-cc15-4a18-80fe-a530ae497091 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:41.924440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 549/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:41 2022] GET /identity/v3/role_assignments?user.id=b42e4db81f3d4bbbb5916fd5dfb6e835&scope.project.id=c95acf8640eb4427826a2efdb9b4b50a&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:43.959849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc978ec-76fb-406b-9ea8-ce955fab04ee None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:43.960392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc978ec-76fb-406b-9ea8-ce955fab04ee None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:43.960392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc978ec-76fb-406b-9ea8-ce955fab04ee None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:43.961835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 558/1107] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:43.967054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:43.967477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:43.967608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:43.985402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:43.986592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:44.051900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 550/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:44.077457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc978ec-76fb-406b-9ea8-ce955fab04ee None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:44.177872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc978ec-76fb-406b-9ea8-ce955fab04ee None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:44.193643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:44.212909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:44.213663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:44.213946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:44.214223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:44.215525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:44.216945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ebdf23-a9a6-4a8a-b622-4e02f06ede6d None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:44.218600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 559/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:44.224349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:44.321753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984f391-5797-4fbf-a3c8-1e0b3b91c2ee None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:44.345318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:44.357222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:44.357888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:44.358173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:44.358453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:44.359163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:44.360580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39d09b-d5c6-4e1c-8f3c-a63d2afe7f3e None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:44.459918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 551/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:08:44 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:46.510006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f91b5-be25-4a5f-9278-f5c06640ade6 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:46.510524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f91b5-be25-4a5f-9278-f5c06640ade6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:46.510613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f91b5-be25-4a5f-9278-f5c06640ade6 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:46.512085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 560/1111] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:46.517250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:46.517662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:46.517813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:46.534693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:46.535872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:46.600445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 552/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:46.623961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f91b5-be25-4a5f-9278-f5c06640ade6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:46.723650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f91b5-be25-4a5f-9278-f5c06640ade6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:46.756537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:46.757407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:46.757689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:46.757959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] PATH_INFO: `/v3/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:46.759450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] RBAC: Authorizing `identity:get_role(role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:46.760863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:46.762938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 561/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:46 2022] GET /identity/v3/roles/da841affa12f4aa58bdf9bf9f469204c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:46.768590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:46.864270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f4a61b-6d46-47cd-ad71-2dc8f7ec853b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:46.873691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:46.897571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:46.900088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:46.900088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:46.900088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] PATH_INFO: `/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:46.911644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] RBAC: Authorizing `identity:get_user(user_id=84a0a1d4c72b461cb7461ceed6bb54f4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:46.913113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:46.914730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 553/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:46 2022] GET /identity/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:46.920936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:46.970102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:47.019143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabb0f4-2a0b-4d94-a890-112fce874f54 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:47.051637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:47.052278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:47.052561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:47.052834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:47.117796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:47.119230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:47.165161 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:47.214356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 562/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:47.220394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:47.316459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b041f-a4c8-41b1-80c3-9eef0fc51f61 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:47.349271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:47.350107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:47.350389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:47.350665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:47.351826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:47.353269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93589c60-52b2-41c8-98c0-11f73343e752 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:47.355056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 554/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:47 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:47.360886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:47.456220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd9f512-e4a8-4ec8-8829-2070ebd3d269 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:47.488409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:47.489068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:47.489349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:47.489622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:47.490434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=c95acf8640eb4427826a2efdb9b4b50a, user.id=84a0a1d4c72b461cb7461ceed6bb54f4) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:47.490742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:47.492140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0ca2d-1ef1-44f6-8c08-232e5996f8ae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:47.498102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 563/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:47 2022] GET /identity/v3/role_assignments?user.id=84a0a1d4c72b461cb7461ceed6bb54f4&scope.project.id=c95acf8640eb4427826a2efdb9b4b50a&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:49.488745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aad4b-0fe0-43c4-a689-28afbc68d1be None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:49.489288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aad4b-0fe0-43c4-a689-28afbc68d1be None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:49.489367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990aad4b-0fe0-43c4-a689-28afbc68d1be None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:49.490682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 555/1118] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:49.496549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:49.496962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:49.497126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:49.513488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:49.514674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:49.523737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:49.579882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 564/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:49.602820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aad4b-0fe0-43c4-a689-28afbc68d1be None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:49.638442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:49.704783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990aad4b-0fe0-43c4-a689-28afbc68d1be None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:49.738875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:49.739653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:49.739935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:49.740211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] PATH_INFO: `/v3/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:49.741702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] RBAC: Authorizing `identity:get_role(role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:49.743089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:49.744461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 556/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:49 2022] GET /identity/v3/roles/da841affa12f4aa58bdf9bf9f469204c => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:49.750364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:49.846031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e20ac5-5233-4e13-9072-4c4a81b2f877 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:49.878756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:49.879608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:49.879887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:49.880159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] PATH_INFO: `/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:49.881344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] RBAC: Authorizing `identity:get_user(user_id=84a0a1d4c72b461cb7461ceed6bb54f4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:49.882752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:49.884354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 565/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:49 2022] GET /identity/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:49.890715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:49.986704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40fe4-f98d-4e29-a9ae-4822ee90cce8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:49.988195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:50.020058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:50.020840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:50.021404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:50.021982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:50.023174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:50.024590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a13334-f8da-4ac8-b111-026f0183047a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:50.026300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 557/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:49 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:50.032908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:50.047135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:50.127436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54772a39-232c-4d0f-b770-431979c80af9 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:50.159537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:50.160408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:50.160688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:50.160962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a/users/84a0a1d4c72b461cb7461ceed6bb54f4/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:50.163137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] RBAC: Authorizing `identity:create_grant(project_id=c95acf8640eb4427826a2efdb9b4b50a, user_id=84a0a1d4c72b461cb7461ceed6bb54f4, role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:50.164549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1492e48-1fc9-4d20-8137-5a6b96e69179 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:50.248916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 566/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:08:50 2022] PUT /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a/users/84a0a1d4c72b461cb7461ceed6bb54f4/roles/da841affa12f4aa58bdf9bf9f469204c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:08:52.245280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ed11-2384-4e1d-ad21-6ba42c834ba3 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:52.245776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ed11-2384-4e1d-ad21-6ba42c834ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:52.245776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2826ed11-2384-4e1d-ad21-6ba42c834ba3 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:52.247789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 558/1124] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:52.252883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:52.253279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:52.253475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:52.269859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:52.271047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:52.336754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 567/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:52.360782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826ed11-2384-4e1d-ad21-6ba42c834ba3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:52.459869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2826ed11-2384-4e1d-ad21-6ba42c834ba3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:52.492501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:52.493360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:52.493643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:52.493915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] PATH_INFO: `/v3/roles/da841affa12f4aa58bdf9bf9f469204c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:52.495477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] RBAC: Authorizing `identity:get_role(role_id=da841affa12f4aa58bdf9bf9f469204c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:52.496769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:52.498140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 559/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:52 2022] GET /identity/v3/roles/da841affa12f4aa58bdf9bf9f469204c => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:52.503712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:52.505891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:52.599096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4de4d-406e-4f28-a82c-4770c947a921 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:52.631359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:52.632212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:52.632490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:52.632758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] PATH_INFO: `/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:52.633940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=84a0a1d4c72b461cb7461ceed6bb54f4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:52.635356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:52.637128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 568/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:08:52 2022] GET /identity/v3/users/84a0a1d4c72b461cb7461ceed6bb54f4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:52.642701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:52.684296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:52.744259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654921c0-555c-4ceb-aa7b-e022c4e88881 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:52.779140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:52.779723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:52.780010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:52.780289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:52.846705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:52.848136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:52.885571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:52.947139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 560/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:08:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:08:52.953365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:53.021175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:53.051119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b581c-1974-43d5-9c44-7b2e93c05fe5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:53.088320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:53.089223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:53.089505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:53.089775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] PATH_INFO: `/v3/projects/c95acf8640eb4427826a2efdb9b4b50a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:53.090936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] RBAC: Authorizing `identity:get_project(project_id=c95acf8640eb4427826a2efdb9b4b50a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:53.092334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15abead-12e8-45e9-9ab4-6118b5b523b2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:53.094045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 569/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:08:52 2022] GET /identity/v3/projects/c95acf8640eb4427826a2efdb9b4b50a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:53.100029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:53.196013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54f19-ee33-43c8-9727-37a741bd2d3d None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:53.228491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:53.229155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:53.229444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:53.230245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:53.231073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] RBAC: Adding query filter params (role.id=da841affa12f4aa58bdf9bf9f469204c, scope.project.id=c95acf8640eb4427826a2efdb9b4b50a, user.id=84a0a1d4c72b461cb7461ceed6bb54f4) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:08:53.231380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:53.232785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748a3cf6-9101-4ec2-827d-0a6878eddbe9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:53.238402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 561/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:08:53 2022] GET /identity/v3/role_assignments?user.id=84a0a1d4c72b461cb7461ceed6bb54f4&scope.project.id=c95acf8640eb4427826a2efdb9b4b50a&role.id=da841affa12f4aa58bdf9bf9f469204c => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:55.264607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eae8-0aa9-498a-9272-9e544f0e619a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:55.265175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eae8-0aa9-498a-9272-9e544f0e619a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:55.265175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eae8-0aa9-498a-9272-9e544f0e619a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:55.266478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 570/1131] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:55.271460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:55.271884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:55.272019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:55.277782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:55.289466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:55.300293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:55.355343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 562/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:55.378155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96eae8-0aa9-498a-9272-9e544f0e619a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:55.476703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96eae8-0aa9-498a-9272-9e544f0e619a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:55.508959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:55.509757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:55.510035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:55.510304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:55.512021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:55.513459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d5ddc-d502-44a8-9b46-0f92da0078f9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:55.515102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 571/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:55.520744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:55.616012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9906e35-548a-403d-897d-8a957c205ad3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:55.644595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:55.649690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:55.654744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:55.654744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:55.654744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:55.654744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:55.654744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33433351-c850-4ce4-bd3c-557287dec927 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:55.722553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 563/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:08:55 2022] POST /identity/v3/projects => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:08:57.769875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158f04-e645-4c9e-88c3-d6e4641ea7b1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:57.770429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158f04-e645-4c9e-88c3-d6e4641ea7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:57.770429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3158f04-e645-4c9e-88c3-d6e4641ea7b1 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:57.771805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 572/1135] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:08:57.777565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:57.777934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:57.778126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:57.795195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:08:57.796380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:08:57.862301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 564/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:08:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:08:57.887014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3158f04-e645-4c9e-88c3-d6e4641ea7b1 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:57.895886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:57.987066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3158f04-e645-4c9e-88c3-d6e4641ea7b1 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:58.019168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:58.019996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:58.020229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:58.020501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:58.021737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:58.023154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28540cd-c575-46ee-81ef-e56989bfc744 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:58.024776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 573/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:08:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:08:58.031322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:08:58.127276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda81de-6b35-4256-9879-a46a9362c2a6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:08:58.141929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:08:58.162024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:08:58.162680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:08:58.162959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:08:58.163235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:08:58.163946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:08:58.165374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1f2fd0-8282-49a8-a8ad-2fe25213f54b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:08:58.265814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 565/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:08:58 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:09:00.310366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e417-2f2c-46d4-af08-cb58119d3d70 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:00.310899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e417-2f2c-46d4-af08-cb58119d3d70 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:00.310899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e117e417-2f2c-46d4-af08-cb58119d3d70 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:00.312229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 574/1139] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:09:00.317270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:00.317656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:00.317823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:00.334845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:00.336004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:00.399928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 566/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:00.423063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e417-2f2c-46d4-af08-cb58119d3d70 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:00.498164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:00.524090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e117e417-2f2c-46d4-af08-cb58119d3d70 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:00.558125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:00.559387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:00.559676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:00.559954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:00.569863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:00.578238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:00.579399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:00.580486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 575/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:00.585632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:00.680297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:00.683753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e49ec5-0216-4bd8-ae63-a7b09213a16a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:00.716705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:00.717392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:00.717680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:00.717966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:00.718735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:00.719043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:00.720403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:00.728548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 567/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:00.735284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:00.835867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba2d70-98f2-43a8-9808-a04528a7686d None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:00.868901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:00.869778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:00.870575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:00.870845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] PATH_INFO: `/v3/users/28d65086e803431089b01b42136c03bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:00.872762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:00.883982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] RBAC: Authorizing `identity:get_user(user_id=28d65086e803431089b01b42136c03bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:00.885470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:00.887756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 576/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:00 2022] GET /identity/v3/users/28d65086e803431089b01b42136c03bf => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:00.893504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:00.991043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02745f42-f761-4573-af3d-5dec031a3db0 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:01.023561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:01.024216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:01.024496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:01.024771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:01.052768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:01.090070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:01.091423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:01.184326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 568/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:09:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:09:01.190318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:01.287314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079a54-a9b4-4554-9699-b4f31b02d10c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:01.319427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:01.320266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:01.320551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:01.320827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] PATH_INFO: `/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:01.322009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] RBAC: Authorizing `identity:get_project(project_id=da2e4ca6418d4beb9c5c0113d54a228f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:01.323971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18888ad4-572f-4d8a-8daf-2cad60c1ff22 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:01.325667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 577/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:01 2022] GET /identity/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:01.331626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:01.392643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:01.430618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511b709-b817-4e2e-aad0-8551f834e6dc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:01.464765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:01.465436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:01.465720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:01.465990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:01.466812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=da2e4ca6418d4beb9c5c0113d54a228f, user.id=28d65086e803431089b01b42136c03bf) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:01.467122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:01.468521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a1108-8734-4d1f-be1e-55499ed4b798 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:01.473814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 569/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:09:01 2022] GET /identity/v3/role_assignments?user.id=28d65086e803431089b01b42136c03bf&scope.project.id=da2e4ca6418d4beb9c5c0113d54a228f&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:03.470554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561090d-f200-467b-9659-928d0cd655c9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:03.471092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561090d-f200-467b-9659-928d0cd655c9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:03.471092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561090d-f200-467b-9659-928d0cd655c9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:03.472487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 578/1147] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:03.477594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:03.478018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:03.478144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:03.495639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:03.496818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:03.561453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 570/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:03.583938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561090d-f200-467b-9659-928d0cd655c9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:03.642393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:03.683829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561090d-f200-467b-9659-928d0cd655c9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:03.715662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:03.716433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:03.716712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:03.716982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:03.726962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:03.735041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:03.736150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:03.737231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 579/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:03.742254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:03.796998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:03.839428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2cd9fa-24fc-43db-87b8-fbfaae37e017 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:03.872559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:03.873236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:03.873520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:03.873796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:03.874543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:03.874852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:03.876200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:03.884058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 571/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:03.889971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:03.988595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68dd8c-bf07-432e-a550-1b7a8dffb75c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:04.007288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:04.020794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:04.021681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:04.021967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:04.022242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] PATH_INFO: `/v3/users/28d65086e803431089b01b42136c03bf` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:04.023412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] RBAC: Authorizing `identity:get_user(user_id=28d65086e803431089b01b42136c03bf)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:04.024867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:04.027043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 580/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:03 2022] GET /identity/v3/users/28d65086e803431089b01b42136c03bf => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:04.032954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:04.129574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ace1-ea99-417e-95ea-61f5042cd554 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:04.145665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:04.161453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:04.162298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:04.162581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:04.162857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] PATH_INFO: `/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:04.164021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] RBAC: Authorizing `identity:get_project(project_id=da2e4ca6418d4beb9c5c0113d54a228f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:04.165470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f6d66e-6a7b-497b-a15d-4de0e3b88d55 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:04.167764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 572/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:04 2022] GET /identity/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:04.173735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:04.270741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929bca3d-3ae3-4f08-a983-dc2ad10077c2 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:04.302519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:04.303378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:04.303658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:04.303929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] PATH_INFO: `/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f/users/28d65086e803431089b01b42136c03bf/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:04.305865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] RBAC: Authorizing `identity:create_grant(project_id=da2e4ca6418d4beb9c5c0113d54a228f, user_id=28d65086e803431089b01b42136c03bf, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:04.307268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48602f1-cfaa-45b8-b5e7-ebce29a1405a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:04.378734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 581/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:09:04 2022] PUT /identity/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f/users/28d65086e803431089b01b42136c03bf/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:09:06.376845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef634dc-8466-4feb-a528-8abb21a60530 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:06.377388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef634dc-8466-4feb-a528-8abb21a60530 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:06.377388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef634dc-8466-4feb-a528-8abb21a60530 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:06.378691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 573/1154] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:06.383864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:06.384229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:06.384421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:06.401310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:06.402653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:06.446171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:06.471878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 582/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:06.496636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef634dc-8466-4feb-a528-8abb21a60530 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:06.593979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef634dc-8466-4feb-a528-8abb21a60530 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:06.625791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:06.626559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:06.626839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:06.627160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:06.637841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:06.645324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:06.646387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:09:06.647421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 574/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:06.652470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:06.747424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc3556-db34-44b8-8e62-82e03474d32f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:06.780465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:06.781152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:06.781437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:06.781710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:06.782446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:06.782748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:06.784091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:06.792561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 583/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:06.798488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:06.844147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:06.894466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9111ce-8f42-47bc-abf7-2ee116d67df3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:06.927471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:06.928314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:06.928596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:06.928870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] PATH_INFO: `/v3/users/28d65086e803431089b01b42136c03bf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:06.930074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] RBAC: Authorizing `identity:get_user(user_id=28d65086e803431089b01b42136c03bf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:06.931484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:06.933155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 575/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:06 2022] GET /identity/v3/users/28d65086e803431089b01b42136c03bf => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:06.938876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:06.980845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:07.036835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a379d6-8e6b-42f5-915f-1cb443f93c80 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:07.069388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:07.070026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:07.070308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:07.070581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:07.135403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:07.137465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:07.175560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:07.231896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 584/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:09:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:09:07.237849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:07.335547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c1405-f930-4ef1-92e7-7c982bcaeb9b None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:07.349638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:07.368636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:07.369504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:07.369785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:07.370167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] PATH_INFO: `/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:07.371349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] RBAC: Authorizing `identity:get_project(project_id=da2e4ca6418d4beb9c5c0113d54a228f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:07.372771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791284e-2560-440d-b9f1-e007bb817339 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:07.374981 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 576/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:07 2022] GET /identity/v3/projects/da2e4ca6418d4beb9c5c0113d54a228f => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:07.380654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:07.476343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ace8f-a6e5-4f30-931b-81e741724717 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:07.508765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:07.509435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:07.509717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:07.509992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:07.510922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=da2e4ca6418d4beb9c5c0113d54a228f, user.id=28d65086e803431089b01b42136c03bf) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:07.511234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:07.512653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fd37-c38c-490b-a586-af1fe267fa77 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:07.518319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 585/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:09:07 2022] GET /identity/v3/role_assignments?user.id=28d65086e803431089b01b42136c03bf&scope.project.id=da2e4ca6418d4beb9c5c0113d54a228f&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:09.539817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb0c5-4ca7-44d8-af44-32963420527d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:09.540342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb0c5-4ca7-44d8-af44-32963420527d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:09.540434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb0c5-4ca7-44d8-af44-32963420527d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:09.541827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 577/1162] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:09.546932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:09.547315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:09.547493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:09.553382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:09.564803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:09.566013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:09.630515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 586/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:09.653578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb0c5-4ca7-44d8-af44-32963420527d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:09.752570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bb0c5-4ca7-44d8-af44-32963420527d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:09.785013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:09.785682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:09.785965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:09.786243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:09.833391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:09.851597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:09.853040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:09.947150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 578/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:09:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:09:09.953519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:10.048598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045f4cc-c6fc-419a-8d2d-df16c1b08354 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:10.080482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:10.081291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:10.081568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:10.081835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:10.083725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:10.089311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8d55d04b-9800-41b2-b55e-e1337466da22 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:10.105528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:10.106633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:10.107762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 587/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:09:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:10.112148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:10.191195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:10.208699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc4542-3dbe-44b8-988e-cc04629c46f4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:10.242201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:10.242849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:10.243135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:10.243415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:10.244138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:10.244447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:10.246603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cdb65-6e86-41e7-94f4-4b0acb280c9b None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:10.253591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 579/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Tue Jul 12 07:09:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:12.281586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81dfd-fc07-4ff3-9933-dce70cd57c81 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:12.282098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81dfd-fc07-4ff3-9933-dce70cd57c81 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:12.282098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81dfd-fc07-4ff3-9933-dce70cd57c81 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:12.287593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 588/1167] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:12.293551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9287-9ee4-426c-a373-3d5c9b1b5877 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:12.293958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9287-9ee4-426c-a373-3d5c9b1b5877 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:12.294114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b9287-9ee4-426c-a373-3d5c9b1b5877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:12.310460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-513b9287-9ee4-426c-a373-3d5c9b1b5877 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:12.311664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-513b9287-9ee4-426c-a373-3d5c9b1b5877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:12.376481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 580/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:12.399804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81dfd-fc07-4ff3-9933-dce70cd57c81 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:12.496718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81dfd-fc07-4ff3-9933-dce70cd57c81 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:12.529321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:12.529961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:12.530241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:12.530517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:12.531252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:12.532651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5968cc0-022a-4460-ad2b-79b01ac985cc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:12.625965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 589/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Tue Jul 12 07:09:12 2022] POST /identity/v3/domains => generated 267 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:09:14.681426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7b0b-500f-44b8-af35-9feb01025f48 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:14.681946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7b0b-500f-44b8-af35-9feb01025f48 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:14.682060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839f7b0b-500f-44b8-af35-9feb01025f48 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:14.683373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 581/1170] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:14.688510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:14.688905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:14.689105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:14.706281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:14.707467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:14.755163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:14.772567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 590/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:14.796278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7b0b-500f-44b8-af35-9feb01025f48 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:14.879133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:14.903012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839f7b0b-500f-44b8-af35-9feb01025f48 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:14.936102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:14.936884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:14.937193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:14.937471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] PATH_INFO: `/v3/domains/7e5129eee741402e86e543934431d8aa` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:14.947452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=7e5129eee741402e86e543934431d8aa)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:14.949787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5fb10-0733-4b40-bf50-f02e8bf81f4c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:14.951411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 582/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Jul 12 07:09:14 2022] GET /identity/v3/domains/7e5129eee741402e86e543934431d8aa => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:14.957227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:15.052722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53051-af2b-4c76-9e43-3e42579f5fcc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:15.086070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:15.086721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:15.087007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:15.087284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:15.087989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:15.089499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f7bab-bc76-4fcd-b320-6f0b340141e8 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:15.180498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 591/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:09:14 2022] POST /identity/v3/projects => generated 361 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:09:17.234194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381e6a-5fc5-4b24-86f2-9d0dd7eaf109 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:17.234692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381e6a-5fc5-4b24-86f2-9d0dd7eaf109 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:17.234692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381e6a-5fc5-4b24-86f2-9d0dd7eaf109 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:17.236038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 583/1174] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:17.241013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:17.241425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:17.241593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:17.259103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:17.260657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:17.289274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:17.328798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 592/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:17.354856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381e6a-5fc5-4b24-86f2-9d0dd7eaf109 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:17.453446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381e6a-5fc5-4b24-86f2-9d0dd7eaf109 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:17.485516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:17.486290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:17.486572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:17.486846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] PATH_INFO: `/v3/domains/7e5129eee741402e86e543934431d8aa` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:17.488010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7e5129eee741402e86e543934431d8aa)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:17.489455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe10d-3225-4594-b6b7-cbd3aeaf28d2 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:17.491037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 584/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Tue Jul 12 07:09:17 2022] GET /identity/v3/domains/7e5129eee741402e86e543934431d8aa => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:17.497259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:17.592630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4895bc-ff52-42c4-9bf5-f28ad32e7630 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:17.625142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:17.625798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:17.626079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:17.626351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:17.627045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:17.628456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17ac21-743a-4b58-a2c0-fc56381a08f5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:17.688227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 593/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:09:17 2022] POST /identity/v3/users => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:09:19.714944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5c54-2851-4689-b615-a679755146dc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:19.715468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5c54-2851-4689-b615-a679755146dc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:19.715559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d5c54-2851-4689-b615-a679755146dc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:19.716855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 585/1178] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:19.721889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:19.722292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:19.722447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:19.739171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:19.740341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:19.756333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:19.804225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 594/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:19.828643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5c54-2851-4689-b615-a679755146dc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:19.832335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:19.927200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d5c54-2851-4689-b615-a679755146dc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:19.960235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:19.961044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:19.961330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:19.961607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:19.972730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:19.980414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:19.981517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:09:19.982556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 586/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:19.987509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:20.082262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16645f1-b73f-421d-b1bc-33bb388d7aa7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:20.114424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:20.115068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:20.115347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:20.115619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:20.116350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:20.116651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:20.118035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:20.126488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 595/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:20.132059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:20.192915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:20.229636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417c6c6-55a3-42af-96ac-b4db28ff79e1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:20.262946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:20.263801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:20.264083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:20.264355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] PATH_INFO: `/v3/users/9b91c58033584ec7a1d97a1116f67449` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:20.277448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] RBAC: Authorizing `identity:get_user(user_id=9b91c58033584ec7a1d97a1116f67449)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:20.278871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:20.280506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 587/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:20 2022] GET /identity/v3/users/9b91c58033584ec7a1d97a1116f67449 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:20.286122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:20.302282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:20.383048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fe689-66ff-47c3-a768-678def0c8de3 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:20.415423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:20.416058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:20.416917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:20.417285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:20.482233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:20.483608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:20.497786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:20.580398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 596/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:09:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:09:20.586237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:20.749917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb3db8-cf40-4af0-9bb7-2c309033d833 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:20.771343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:20.782568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:20.783421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:20.783745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:20.784015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] PATH_INFO: `/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:20.785216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] RBAC: Authorizing `identity:get_project(project_id=046aa2fc4ef9492cb7b751acfd7080ab)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:20.786629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0e9b8b-ef7e-420b-8680-c43ed291afa0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:20.788305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 588/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:20 2022] GET /identity/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab => generated 361 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:20.795005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:20.891937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea55c8-1b10-4266-8845-ab01a78a43ee None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:20.904919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:20.924198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:20.924846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:20.925163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:20.925442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:20.926260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=046aa2fc4ef9492cb7b751acfd7080ab, user.id=9b91c58033584ec7a1d97a1116f67449) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:20.926569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:20.927985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211eec7-0704-4290-a34c-bbf5922d98f5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:20.934268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 597/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:09:20 2022] GET /identity/v3/role_assignments?user.id=9b91c58033584ec7a1d97a1116f67449&scope.project.id=046aa2fc4ef9492cb7b751acfd7080ab&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:22.924008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051a11-3710-461c-94e5-e9d859c530d1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:22.924539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051a11-3710-461c-94e5-e9d859c530d1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:22.924539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051a11-3710-461c-94e5-e9d859c530d1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:22.925989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 589/1186] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:22.931355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:22.931747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:22.931959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:22.949203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:22.950384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:23.015025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 598/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:23.037334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051a11-3710-461c-94e5-e9d859c530d1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:23.134831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051a11-3710-461c-94e5-e9d859c530d1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:23.169132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:23.169891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:23.170172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:23.170441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:23.180135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:23.187494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:23.188547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:09:23.189618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 590/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:23.194557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:23.290329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516550ed-1ccd-4f2e-841b-0e3cdd70cb29 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:23.299263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:23.323881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:23.324536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:23.326878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:23.326878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:23.326878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:23.326878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:23.327455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:23.335179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 599/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:23.341039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:23.389594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:23.437280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8e3249-1af5-4bfe-aede-c3283179d4ad None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:23.469562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:23.470397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:23.470677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:23.470950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] PATH_INFO: `/v3/users/9b91c58033584ec7a1d97a1116f67449` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:23.472106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] RBAC: Authorizing `identity:get_user(user_id=9b91c58033584ec7a1d97a1116f67449)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:23.473549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:23.475128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 591/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:23 2022] GET /identity/v3/users/9b91c58033584ec7a1d97a1116f67449 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:23.481010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:23.576676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099659fa-5f4e-4bd1-920b-0a2d20c18824 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:23.609030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:23.609902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:23.610173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:23.610447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] PATH_INFO: `/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:23.611607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] RBAC: Authorizing `identity:get_project(project_id=046aa2fc4ef9492cb7b751acfd7080ab)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:23.613049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d12c2-0d27-4191-bc8a-567dfa737cbf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:23.614709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 600/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:23 2022] GET /identity/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:23.620865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:23.716074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f55ed-fb94-47ba-a920-248c5f9032f3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:23.732562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:23.748932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:23.749824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:23.750104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:23.750371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] PATH_INFO: `/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab/users/9b91c58033584ec7a1d97a1116f67449/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:23.752352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=046aa2fc4ef9492cb7b751acfd7080ab, user_id=9b91c58033584ec7a1d97a1116f67449, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:23.753786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063de398-4309-4372-9076-6e2d23f50bf9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:23.807807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 592/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:09:23 2022] PUT /identity/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab/users/9b91c58033584ec7a1d97a1116f67449/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:09:25.805952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482c1c-9761-45ac-b8bc-e344fcbcf662 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:25.806587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482c1c-9761-45ac-b8bc-e344fcbcf662 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:25.806587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df482c1c-9761-45ac-b8bc-e344fcbcf662 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:25.808540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 601/1193] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:09:25.813729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:25.814153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:25.814260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:25.832194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:09:25.833402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:09:25.897683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 593/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:09:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:09:25.921697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482c1c-9761-45ac-b8bc-e344fcbcf662 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:25.962351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:26.022198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df482c1c-9761-45ac-b8bc-e344fcbcf662 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.054963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.055747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.056083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.056315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.066779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:09:26.074899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:09:26.076073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:09:26.077353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 602/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:09:26.082099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:26.177511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97d61d-7293-467b-b3a2-46a930aab01a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.186621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:26.210979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.211676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.212193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.212495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.214136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:26.214910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:26.216320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:26.224081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 594/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:09:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:26.229955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:26.325941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:26.329655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2a39-35d9-4213-9e6a-672fc358ff18 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.363018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.363874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.364155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.364429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] PATH_INFO: `/v3/users/9b91c58033584ec7a1d97a1116f67449` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.365632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] RBAC: Authorizing `identity:get_user(user_id=9b91c58033584ec7a1d97a1116f67449)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:26.367048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:26.368672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 603/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Tue Jul 12 07:09:26 2022] GET /identity/v3/users/9b91c58033584ec7a1d97a1116f67449 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:26.374929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:26.472017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30c3638-bcab-40af-94df-585364ce040c None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.504087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.504713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.504992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.505301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.544091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:26.576959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:26.578381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:26.683678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 595/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:09:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:09:26.689640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:26.787796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0908b41-cccc-47f3-90f5-cbb7971b6673 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.821598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.822531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.822917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.823199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] PATH_INFO: `/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.824667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] RBAC: Authorizing `identity:get_project(project_id=046aa2fc4ef9492cb7b751acfd7080ab)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:26.826133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb206866-2295-46a3-81e5-9f6304de573c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:26.827913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 604/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Tue Jul 12 07:09:26 2022] GET /identity/v3/projects/046aa2fc4ef9492cb7b751acfd7080ab => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:26.834021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:09:26.907841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:26.939548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485dbca-9ded-43e5-bc1b-717d846969b8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:09:26.975109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:09:26.975777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:09:26.976070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:09:26.976348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:09:26.977223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=046aa2fc4ef9492cb7b751acfd7080ab, user.id=9b91c58033584ec7a1d97a1116f67449) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:09:26.977539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:09:26.979453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d29325-f2e1-4d50-be46-fe47e67ce7f4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:09:26.985610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 596/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:09:26 2022] GET /identity/v3/role_assignments?user.id=9b91c58033584ec7a1d97a1116f67449&scope.project.id=046aa2fc4ef9492cb7b751acfd7080ab&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:09:36.817382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=83 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:09:36.982816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=33 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:36.615351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875183-cdd8-4f0c-b5b2-e75f4aac8e78 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:36.615934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875183-cdd8-4f0c-b5b2-e75f4aac8e78 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:36.615934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33875183-cdd8-4f0c-b5b2-e75f4aac8e78 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:36.617353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 605/1201] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:36.622554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:36.622974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:36.623113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:36.640760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:36.641989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:36.707932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 597/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:36.732891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875183-cdd8-4f0c-b5b2-e75f4aac8e78 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:36.833213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33875183-cdd8-4f0c-b5b2-e75f4aac8e78 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:36.865887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:36.866600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:36.866876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:36.867206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:36.877094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:36.878513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:36.896563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:36.897793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:36.898931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:36.898931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:36.898931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:36.898931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:36.898931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 606/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:36.903924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:37.003928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6c7ac-3893-4d62-a791-a4a07a81d456 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:37.033342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:37.038995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:37.039655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:37.039939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:37.040269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:37.041107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:37.041420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:37.042786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a37be73-331d-4f80-acad-1e7a65ec7bea None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:37.054082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 598/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:10:37.059983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:37.113098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:37.157828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fab8d6-ddfe-4b61-93f2-2d5ac0a851b1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:37.190633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:37.194535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:37.194535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:37.194535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:37.194535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:37.194535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9a649-2ca6-4921-bf3c-39f36745462a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:37.310327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 607/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Tue Jul 12 07:10:37 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:10:39.393643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b429-00a2-4e80-954e-d3cef65b7c69 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:39.394162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b429-00a2-4e80-954e-d3cef65b7c69 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:39.394162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134b429-00a2-4e80-954e-d3cef65b7c69 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:39.395479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 599/1206] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:39.400692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:39.406339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:39.406339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:39.418105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:39.419264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:39.485014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 608/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:39.508666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134b429-00a2-4e80-954e-d3cef65b7c69 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:39.608699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134b429-00a2-4e80-954e-d3cef65b7c69 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:39.642086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:39.642870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:39.643150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:39.643425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:39.653807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:10:39.661443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:39.662575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:39.663535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 600/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:10:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:39.668683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:39.709363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:39.766827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cc8655-59c9-4ea9-add4-86cdcb82b3a8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:39.798657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:39.799319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:39.799588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:39.799863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:39.803077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:39.803077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:39.803077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:39.812139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 609/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:10:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:39.818116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:39.867795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:39.914733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc3c95-6d25-4f12-8393-45d3f22b4b52 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:39.949531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:39.950313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:39.950596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:39.950872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:39.961040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:39.962476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:39.979733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:39.980796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:39.981899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:39.981899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:39.981899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:39.981899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:39.981899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 601/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:10:39.987318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:40.085437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:40.088303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb1018-8809-4a5f-9a52-57b29eb9610e None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:40.121043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:40.121738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:40.122002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:40.122276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:40.123021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:40.123516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:40.124881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:40.135743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 610/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:40.141549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:40.242023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12d725-33d5-45e4-8ce3-0116169c40f3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:40.243439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:40.274789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:40.275571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:40.275856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:40.276124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:40.283534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:40.284952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:10:40.299864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:40.301451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:40.302666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 602/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:40.306775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:40.405946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e53ba-6403-4e62-94c2-999494dbd73c None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:40.438102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:40.438785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:40.439046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:40.439315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:40.440139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:40.440446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:40.441889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:40.459656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 611/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:10:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:10:40.465592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:40.564994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad9bfd-8089-44cb-b851-2d121ef6f168 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:40.598769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:40.599399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:40.599680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:40.599952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:40.630070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:40.665933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:40.667375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:40.763531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 603/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:10:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:10:40.769470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:40.788456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:40.868930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc97b4-4bc1-4130-bb59-d2ac6d8ab121 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:40.902259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:40.903036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:40.903315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:40.903586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:40.915682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:40.917324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:40.934873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:40.936185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:40.937321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:40.937321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:40.937321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:40.937321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:40.937321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 612/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:40.942046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:41.004701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:41.041949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241653ae-f118-4c43-968e-eb940800c1d5 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:41.076987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:41.077679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:41.077962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:41.078239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:41.078957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:41.079264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:41.080629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:41.091678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 604/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:41.097508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:41.166223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:41.196858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb312d-f0ed-4864-8395-f5771a44f698 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:41.232282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:41.233263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:41.233549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:41.233825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:41.240390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:41.241966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:10:41.256872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:41.258015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:41.259415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 613/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:10:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:41.264413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:41.362778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234715f0-2391-4c27-8d9a-2639129f256f None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:41.383941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:41.395585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:41.396235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:41.396516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:41.396788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:41.397601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:41.403028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:41.403028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860a25-f7cb-48e1-a2fc-7625d70ad7e1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:41.411709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 605/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:10:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:41.417939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:41.519961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100204-1d82-4431-96a6-47b6d146bc43 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:41.547643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:41.553285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:41.553932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:41.554209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:41.554479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:41.555295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=231bf5521c35488f864e6bad34fdaf41) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:41.555603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:41.557007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07654c7d-7ef4-4d22-b78a-69327db22e79 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:41.567158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 614/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:10:41 2022] GET /identity/v3/role_assignments?user.id=231bf5521c35488f864e6bad34fdaf41&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:43.564315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df3-a2b2-46e9-a754-d68e705f3508 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:43.564864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df3-a2b2-46e9-a754-d68e705f3508 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:43.564864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d43df3-a2b2-46e9-a754-d68e705f3508 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:43.566286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 606/1220] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:43.571543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:43.577357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:43.577357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:43.589369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:43.590545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:43.656888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 615/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:43.680459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d43df3-a2b2-46e9-a754-d68e705f3508 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:43.784238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d43df3-a2b2-46e9-a754-d68e705f3508 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:43.819461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:43.820233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:43.820517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:43.820792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:43.831575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:10:43.839271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:43.843904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:43.844970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 607/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:10:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:43.846828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:43.944735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cd8b8-40a1-4649-a838-40c6b1020595 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:43.969481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:43.980109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:43.980770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:43.981079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:43.981428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:43.982169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] RBAC: Adding query filter params (name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:43.982678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:43.984228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:43.991934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 616/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:10:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:43.997699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.041992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:44.097632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6df74d-2c03-4f87-97a4-7bb9e647bfec None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.130765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.131537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.131820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.132095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.142423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.143849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:44.160673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:44.161585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:44.162464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:44.162464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:44.162464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:44.162464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:44.162464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 608/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:44.167815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.264814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135703f8-a3b7-47b9-9679-86217686b80a None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.297323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.297975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.298256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.298531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.299272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:44.299575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.300924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.312910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 617/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:44.319084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.412766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:44.419326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a7431-1c90-4aea-b82f-e191790ae5ea None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.452085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.452875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.453197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.453471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.460854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.462381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:10:44.477611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:44.478801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:44.479960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 609/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:44.485611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.534202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:44.590701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5854aa3-7687-4c8a-a5f1-ac0527b7c399 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.625679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.626407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.626683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.626954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.627779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:44.628085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.629551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.646750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 618/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:44.652358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.750944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265a326-e337-4650-8a3b-4cafe86169a4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.784076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.784855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.785169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.785445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.795737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.797198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:44.814421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:44.815495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:44.822489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:44.822489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:44.822489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:44.822489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:44.822489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 610/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:44.822854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.918854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ca48d-4a20-4cb0-aa82-616e475dd7fb None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:44.921785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:44.952259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:44.953010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:44.953276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:44.953551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:44.954270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:44.954574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:44.955937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:44.969679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 619/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:10:44.975344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:44.985692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:45.075191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a568-b379-439a-bd51-35a8572b40c1 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:45.109976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:45.110759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:45.111038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:45.111309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:45.117835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:45.119301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:10:45.133697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:45.134735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:45.135739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 611/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:10:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:45.140795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:45.238490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e499292-93fe-4752-a5d2-5ef4cf6f6b02 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:45.271742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:45.272398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:45.272708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:45.272989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:45.273804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:45.274114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:45.275540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bf58-e4b1-4b25-a053-ffbd04d1d669 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:45.288659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 620/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:10:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:45.294631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:45.359921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:45.392304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97d62c-1c3a-4743-a972-87f6cb380705 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:45.425669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:45.426548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:45.426829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:45.427104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/231bf5521c35488f864e6bad34fdaf41/roles/1fa6734d90904c3596ae0070580b52df` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:45.441507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=231bf5521c35488f864e6bad34fdaf41, role_id=1fa6734d90904c3596ae0070580b52df)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:45.442932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226232c5-9b75-47e9-bb05-ebe4d410d4ab None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:45.566453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 612/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:10:45 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/231bf5521c35488f864e6bad34fdaf41/roles/1fa6734d90904c3596ae0070580b52df => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:10:47.560671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31104-b930-4b00-a3dd-551fac394b99 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:47.561256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31104-b930-4b00-a3dd-551fac394b99 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:47.561256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f31104-b930-4b00-a3dd-551fac394b99 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:47.562658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 621/1233] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:47.567754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:47.568168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:47.568305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:47.585855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:47.587089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:47.655087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 613/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:47.679097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31104-b930-4b00-a3dd-551fac394b99 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:47.704306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:47.778658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f31104-b930-4b00-a3dd-551fac394b99 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:47.813662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:47.814376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:47.814654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:47.814926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:47.825268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:10:47.833589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:47.837050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:47.838124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 622/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Tue Jul 12 07:10:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 07:10:47.840863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:47.888189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:47.940814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9e8e8-6dae-41da-ab53-bae7894f8846 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:47.975551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:47.976274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:47.976756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:47.977231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:47.978540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:47.978845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:47.980198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:47.988288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 614/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Tue Jul 12 07:10:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:47.994049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.079703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:48.095341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb6cd7-d67f-4ef3-a851-f545dcd4b4ce None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:48.128533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:48.129343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:48.129629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:48.129903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:48.140554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:48.142045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:48.160527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:48.162276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:48.163158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:48.163158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:48.163158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:48.163158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:48.163158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 623/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:48.167779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.269666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9b910-c930-4525-8ca8-a28d436239a8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:48.278346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:48.302903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:48.303564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:48.303850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:48.304130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:48.304856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:48.305198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:48.306562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:48.319072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 615/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:48.324977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.422934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eae223-5cf8-4822-808e-0418d3c443ae None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:48.457831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:48.458653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:48.458931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:48.459202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:48.461878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:48.466444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:48.468132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:10:48.482528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:48.483640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:48.484629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 624/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:48.489715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.589273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a4fe4-5758-4d78-b6e7-b1de2e07de41 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:48.622623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:48.624047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:48.624333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:48.624609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:48.625483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:48.625795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:48.627231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:48.644226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 616/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:10:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:48.650305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.749487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b39a-3f29-4ab2-ba27-a5bf4f8eda24 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:48.782311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:48.782942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:48.783227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:48.783501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:48.844240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:48.850515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:48.851958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:48.949964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 625/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:10:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:10:48.956019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:48.984209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:49.055704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ce1ca-701c-4873-a2e5-aae9409cae5a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:49.090210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:49.090987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:49.091265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:49.092026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:49.101948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:49.103407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:49.121075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:49.122141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:49.123367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:49.123367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:49.123367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:49.123367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:49.123367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 617/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:49.128002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:49.220542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:49.226039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abe75d1-75e5-4021-ad57-6df41d6d69f4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:49.259068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:49.259728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:49.260013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:49.260288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:49.261008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:49.261343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:49.262701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:49.273613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 626/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:49.280150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:49.359907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:49.381073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de43bea-2dd5-4cbe-a2e4-89071867b6a4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:49.416528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:49.417350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:49.417636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:49.417913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:49.424840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:49.426371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:10:49.440117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:49.441121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:49.442195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 618/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:10:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:49.447276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:49.547662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27797eb-c5ad-4b69-8c2b-792e380749fc None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:49.581180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:49.581822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:49.582118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:49.582376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:49.583157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:49.583460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:49.584878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a8c6d-d29c-448e-b4fd-bb0fd85b8bcf None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:49.597688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 627/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:10:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:49.603688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:49.702262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f867b8f5-ee54-47e4-aac7-04152467c8cc None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:49.735220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:49.735869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:49.736152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:49.737674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:49.737674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] RBAC: Adding query filter params (role.id=1fa6734d90904c3596ae0070580b52df, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=231bf5521c35488f864e6bad34fdaf41) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:49.737674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:49.738976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1631f1-ad36-4bec-aa1a-234c93ff1fb3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:49.744658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 619/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:10:49 2022] GET /identity/v3/role_assignments?user.id=231bf5521c35488f864e6bad34fdaf41&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=1fa6734d90904c3596ae0070580b52df => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:51.808695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a7d6-b705-4017-9cf7-3961c5f00e77 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:51.809255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a7d6-b705-4017-9cf7-3961c5f00e77 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:51.809350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d26a7d6-b705-4017-9cf7-3961c5f00e77 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:51.810918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 628/1247] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:51.816001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:51.816405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:51.816557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:51.821611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:51.835242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:51.836422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:51.900789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 620/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:51.924811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a7d6-b705-4017-9cf7-3961c5f00e77 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:51.943741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:52.026344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d26a7d6-b705-4017-9cf7-3961c5f00e77 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.060005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.060930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.061242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.061559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.071473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:10:52.079507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:52.083117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:52.084180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 629/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:52.086792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.184326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fadd6-8fa4-40a9-8122-e11802c0dec6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.212887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:52.218292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.218953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.219237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.219512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.220255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:52.223294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:52.223294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:52.229777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 621/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:52.236180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.312737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:52.334949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f80912-c7aa-48aa-9504-8898d07a8564 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.367891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.368672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.368958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.369265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.379374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:52.380802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:52.399152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:52.400227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:52.401541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:52.401541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:52.401541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:52.401541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:52.401541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 630/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:52.406651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.504290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45525a-e6d4-4a36-9576-1f94c3fa2ed9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.538073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.538762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.539049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.539329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.540056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:52.540368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:52.541786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:52.553501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 622/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:52.559361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.662759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dc8ab-6efa-43a7-b3b7-c4e560597a13 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.687782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:52.697464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.699018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.699303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.699580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.708801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:52.710330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:10:52.725499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:52.726645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:52.727761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 631/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:52.732672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.788341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:52.833646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a6ec-98d3-4d03-af0d-118e4359fc5a None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:52.866907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:52.867572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:52.867858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:52.868137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:52.868971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:52.869443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:52.870867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:52.888285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 623/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:52.894808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:52.997347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27261c66-c4af-46f0-aca5-f327e60bfd0f None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.031562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.032202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.032483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.032788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:53.087872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:53.099684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:53.101171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:53.199677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 632/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:10:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:10:53.205774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:53.308149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14775d5-c3b4-4d97-bd16-73920bae2526 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.321943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:53.342634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.343423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.343707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.343985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:53.354995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:53.356469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:53.376675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:53.377852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:53.378994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:53.378994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:53.378994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:53.378994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:53.378994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 624/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:53.383709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:53.470221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:53.481612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7994f417-e85f-41df-8937-a21337808d38 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.515950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.516666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.516954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.517261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:53.517989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:53.518323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:53.519685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:53.531391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 633/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:53.537170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:53.637733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1375a-fcca-4f10-9b4d-9c5641e7d986 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.673852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.674641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.674923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.675196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:53.682057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:53.683495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:10:53.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:53.698942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:10:53.704800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 625/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:10:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:53.705778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:53.803479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955c042b-e405-4308-857f-fbabc106ffb1 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.836651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.837421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.837698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.837971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:53.838744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:53.839051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:53.840465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134d4f28-6aa0-457e-8aea-07e6d0629b1e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:53.852609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 634/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:10:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:53.859341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:53.884954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:53.964396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe52c7-8f23-4b7c-82f5-0bd404fef1f3 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:53.998617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:53.999264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:53.999593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:53.999893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:54.000733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=231bf5521c35488f864e6bad34fdaf41) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:54.001069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:54.002483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40682ad5-6b4a-420e-8074-33610e9dc868 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:54.009411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 626/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:10:53 2022] GET /identity/v3/role_assignments?user.id=231bf5521c35488f864e6bad34fdaf41&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:56.024251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876aa1-b0a4-4b81-8774-c37ced48265b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.024764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876aa1-b0a4-4b81-8774-c37ced48265b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.024893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00876aa1-b0a4-4b81-8774-c37ced48265b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.026220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 635/1261] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:56.031612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.032008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.032177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.049225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:10:56.050409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:10:56.117939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 627/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:10:56.141823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00876aa1-b0a4-4b81-8774-c37ced48265b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:56.152732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:56.244249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00876aa1-b0a4-4b81-8774-c37ced48265b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:56.282454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:56.283235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.283516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.283788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.293796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:10:56.302295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:56.305947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:56.306989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 636/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:56.309717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:56.328695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:56.411931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8336949-5df7-4cc7-bd0a-fd50d26b0605 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:56.444729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:56.445422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.445707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.445979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.446863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:56.447172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:56.448528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:56.457718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 628/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:56.463506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:56.531154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:56.564234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a127d97-8078-4919-bc7d-6245fdb8c00b None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:56.598291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:56.599132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.599418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.599695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.612356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:56.613930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:56.630728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:56.631788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:56.632786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:56.632786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:56.632786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:56.632786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:56.632786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 637/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:56.637777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:56.718689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:56.738146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b249f-9090-4ed2-9e04-b1f5f95d1891 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:56.770869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:56.771529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.771814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.772091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.772811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:56.773181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:56.774564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:56.786597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 629/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:56.792675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:56.892585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651c79-0e2c-4498-bf9f-b3f7fe49d4b5 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:56.912484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:56.925742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:56.926532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:56.926815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:56.927088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:56.934283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:56.935954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:10:56.950269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:56.951748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:56.952804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 638/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:56.958388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.057337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bebf96c-4625-4b38-9c97-bf3b41398572 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.092782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.093452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.093736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.094011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.094843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:57.095151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.096553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.104956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:57.113000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 630/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:10:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:57.118677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.218363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406a99b-1c20-429d-a552-c402d733f733 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.253538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.254321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.254633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.254961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.271291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.272795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:10:57.290205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:57.291405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:57.292823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:10:57.292823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:10:57.292823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:10:57.292823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:57.292823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 639/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:57.297371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.398864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fea49-f0c0-4e6f-af97-7ce99c36db09 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.433093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.433770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.434048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.434320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.435090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:57.435453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.436806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.447727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 631/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:57.453649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.485335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:57.555199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee17db2-3a92-439d-bf47-8d493695ee28 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.588102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.588884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.589193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.589468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.597175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.606656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:10:57.613209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:10:57.614294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:10:57.615437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 640/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:10:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:10:57.620546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.677735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:57.718895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fc483-c157-4690-878e-fa997decf9da None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.751811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.752465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.752761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.753082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.753868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:10:57.754181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.755590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6530cfca-28bb-44ef-b9f9-4b5f8dcd2bf3 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.767767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 632/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:10:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:10:57.773799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:10:57.865829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:10:57.875054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402210-b960-4d89-9469-f08793707a63 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:10:57.908996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:10:57.909907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:57.910189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:57.910465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] PATH_INFO: `/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/231bf5521c35488f864e6bad34fdaf41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:57.912412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=eeb4c2659aee4cf4ba0650e10f402ee4, user_id=231bf5521c35488f864e6bad34fdaf41, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:10:57.913905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42f623-bcde-4708-8d56-2baa914123c9 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:10:57.971306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 641/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Tue Jul 12 07:10:57 2022] PUT /identity/v3/projects/eeb4c2659aee4cf4ba0650e10f402ee4/users/231bf5521c35488f864e6bad34fdaf41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:10:59.981690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ef98d-bb60-4764-9478-cfa999253a4b None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:59.982134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ef98d-bb60-4764-9478-cfa999253a4b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:59.982243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ef98d-bb60-4764-9478-cfa999253a4b None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:10:59.983661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 633/1274] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:10:59.988779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:10:59.989236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:10:59.989385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.005931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:11:00.009394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:11:00.073467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 642/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:10:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:11:00.097555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ef98d-bb60-4764-9478-cfa999253a4b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.199970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ef98d-bb60-4764-9478-cfa999253a4b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:00.216935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:00.233357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:00.234145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:00.234461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:00.234773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.244762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 07:11:00.253008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:00.254162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:00.255174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 634/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:00.260178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.339200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:00.357672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85eec5-b845-404c-8684-09641bb7e46b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:00.390889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:00.391554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:00.392564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:00.392564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.392943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:00.393280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:00.394635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:00.402434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 643/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:00.408632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.509273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f511b275-0d85-4712-9441-a20fd087ffe2 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:00.542381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:00.543161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:00.543439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:00.543708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.555831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:00.557285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:11:00.574445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:00.575522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:00.576517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:11:00.576517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:11:00.576517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:11:00.576517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:00.576517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 635/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:00.581688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.684838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13991a-070b-4987-8b36-e30c6f57cf26 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:00.720249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:00.720901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:00.721224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:00.721502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.722216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:00.722525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:00.723889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:00.737353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 644/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:00.743239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.778196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:00.853553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212cfcd-0652-4fb3-ab16-c931f99ebbc7 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:00.889931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:00.890791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:00.891072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:00.891342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:00.899854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:00.901351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 07:11:00.917149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:00.920511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:00.921989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 636/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:00.924744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:00.928851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:01.039009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c408e6f7-f3c8-4962-9554-b80b94bd2013 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:01.078063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:01.078778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:01.079069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:01.079351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:01.080196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:01.080509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:01.081994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:01.100019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 645/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Tue Jul 12 07:11:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:01.105911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:01.202120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:01.211985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b544cbc-128a-4192-9d73-6187783599f4 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:01.245948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:01.246930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:01.247212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:01.247482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:01.318583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:01.319945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:01.409567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:01.419569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 637/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Tue Jul 12 07:11:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 07:11:01.425527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:01.487191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:01.526018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db05b6-04fe-4c54-a03d-43da69388871 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:01.559339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:01.560125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:01.560407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:01.560680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:01.571132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:01.572512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 07:11:01.590077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:01.592106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:01.593765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 07:11:01.593765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 07:11:01.593765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 07:11:01.593765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:11:01.593765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 646/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:01.597731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:01.697086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1302b7-0fea-471b-ad74-16eee604f6a9 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:01.731355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:01.731998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:01.732283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:01.732557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:01.733389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:01.733689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:01.735116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:01.746049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 638/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Tue Jul 12 07:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:01.752264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:01.852462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed3621-d2e3-4cf6-a44e-8938142f4196 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:01.865884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:01.885844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:01.886624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:01.886903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:01.887175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:01.894506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:01.896179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 07:11:01.910405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:01.911439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: ERROR keystone.server.flask.application Jul 12 07:11:01.912544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 647/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Tue Jul 12 07:11:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:01.917526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:01.968305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:02.019697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf813dbc-0dd7-455c-ab18-41f8487845ca None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:02.050888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:02.051529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:02.051808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:02.052078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:02.052853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:02.053188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:02.054587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa71e83-9acc-4536-98a7-345d7a2c69a0 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:02.067284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 639/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Tue Jul 12 07:11:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:02.073383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:02.171068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de464d47-02de-4d2b-9a61-3fc1a9382613 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:02.204946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:02.205627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:02.205912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:02.206187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:02.207046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] RBAC: Adding query filter params (role.id=ac75a1032bab4f8ba653ed71e6b0dfe9, scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4, user.id=231bf5521c35488f864e6bad34fdaf41) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:02.207360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:02.208782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264c2b3-ce77-4039-b15b-3b25c9015fac None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:02.214567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 648/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Tue Jul 12 07:11:02 2022] GET /identity/v3/role_assignments?user.id=231bf5521c35488f864e6bad34fdaf41&scope.project.id=eeb4c2659aee4cf4ba0650e10f402ee4&role.id=ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:04.265842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4276-bebf-4ca8-ab82-a95f580dd627 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:04.266442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4276-bebf-4ca8-ab82-a95f580dd627 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:04.266442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e4276-bebf-4ca8-ab82-a95f580dd627 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:04.268298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 640/1288] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:11:04.273546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:04.275369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:04.275369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:04.290769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:11:04.291934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:11:04.321266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:04.357534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 649/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:11:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:11:04.381117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4276-bebf-4ca8-ab82-a95f580dd627 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:04.481523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e4276-bebf-4ca8-ab82-a95f580dd627 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:04.492755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:04.516235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:04.516966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:04.517293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:04.517571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:04.518258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:04.519653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:04.531431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:04.532656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:04.533715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 641/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:11:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:04.538592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:04.636408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca3b888-a864-49e0-97d0-879e4642401d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:04.668918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:04.669621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:04.669905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:04.670180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:04.671540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:04.671850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:04.673430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9e9f2a-6279-4c1f-a8fe-f76990b5912e None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:04.678553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 650/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 12 07:11:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:04.683960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:04.783865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c372e-ad3b-4b93-82b0-cb3f57d39515 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:04.817126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:04.817790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:04.818074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:04.818349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] PATH_INFO: `/v3/services` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:04.819058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:04.819365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:04.820722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9885b7e-4b29-4ebb-8974-df7991174140 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:04.825435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 642/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 12 07:11:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:06.821179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18f0e-85d2-495b-bed8-1115ddf4fac4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:06.821750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18f0e-85d2-495b-bed8-1115ddf4fac4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:06.821750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b18f0e-85d2-495b-bed8-1115ddf4fac4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:06.823114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 651/1293] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:11:06.829273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ea17-a5eb-4a43-833c-82f881123c8b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:06.829693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ea17-a5eb-4a43-833c-82f881123c8b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:06.829870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8ea17-a5eb-4a43-833c-82f881123c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:06.847102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eea8ea17-a5eb-4a43-833c-82f881123c8b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:11:06.848271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eea8ea17-a5eb-4a43-833c-82f881123c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:11:06.877291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:06.913930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 643/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:11:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:11:06.937076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b18f0e-85d2-495b-bed8-1115ddf4fac4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:06.969745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:07.040128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b18f0e-85d2-495b-bed8-1115ddf4fac4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:07.073565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:07.074490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:07.074771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:07.075040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:07.075747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:07.078188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28b75f-6b9b-430c-a65b-b77458c2a644 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:07.131090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 652/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Tue Jul 12 07:11:06 2022] POST /identity/v3/services => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:11:09.157383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9221-2788-4de6-b926-dc103073e3a6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.157906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9221-2788-4de6-b926-dc103073e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.157906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc9221-2788-4de6-b926-dc103073e3a6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.159357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 644/1296] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:11:09.164498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.164911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.165085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.182367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:11:09.183545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:11:09.255926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 653/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:11:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:11:09.279126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc9221-2788-4de6-b926-dc103073e3a6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:09.381124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc9221-2788-4de6-b926-dc103073e3a6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:09.414343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:09.415138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.415422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.415698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] PATH_INFO: `/v3/services/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.416376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:09.417772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:09.430231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:09.431392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:09.432395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 645/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:11:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:09.437708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:09.455969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:09.535597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36bd898-5434-486b-a79a-4412d4a55b9b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:09.572911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:09.573607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.574449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.574723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.575433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:09.575732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:09.577629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:09.582824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 654/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 12 07:11:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:09.588836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:09.621294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:09.688503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abec4e-c2c8-4cca-956c-ee15960c60af None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:09.722178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:09.722830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.723111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.723385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.724168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] RBAC: Adding query filter params (interface=public, service_id=0beb004e161549ca82118509e0c5aded, region_id=RegionOne) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:09.724476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:09.725850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dcc64d-002c-4b83-bee8-b1790153e330 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:09.730747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 646/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Tue Jul 12 07:11:09 2022] GET /identity/v3/endpoints?service_id=0beb004e161549ca82118509e0c5aded&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:09.736406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:09.814689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:09.832748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e413c805-485e-46c2-b2c4-30df359693a4 None admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:09.866018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:09.866707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:09.866987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:09.867259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:09.867937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:09.869315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1fe4b-a341-49c6-8151-b5e151d06e69 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:09.876081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 655/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Tue Jul 12 07:11:09 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:11:11.905568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8718-bb12-458f-99b6-9b891e3d9526 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:11.906121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8718-bb12-458f-99b6-9b891e3d9526 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:11.906121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b8718-bb12-458f-99b6-9b891e3d9526 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:11.907486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 647/1302] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:11:11.912590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:11.912990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:11.913203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:11.930887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:11:11.932074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:11:12.003117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 656/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:11:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 07:11:12.025431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b8718-bb12-458f-99b6-9b891e3d9526 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:12.121344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:12.128503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b8718-bb12-458f-99b6-9b891e3d9526 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:12.160801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:12.161554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:12.161834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:12.162107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:12.162755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:12.164146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 07:11:12.176312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 07:11:12.177485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application with Lock( Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self._enter() Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application return self.creator() Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application created_value = creator( Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: ERROR keystone.server.flask.application Jul 12 07:11:12.178441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 648/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Tue Jul 12 07:11:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 07:11:12.183615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:12.258689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:12.280861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84049e-1579-48be-b1a0-f1a282717f69 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:12.315076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:12.315731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:12.316011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:12.316281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] PATH_INFO: `/v3/services` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:12.316977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:11:12.317312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:12.318663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc0b56-9dbc-47b9-8659-b7a6166cbab0 None admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:12.324009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 657/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Tue Jul 12 07:11:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:11:12.330034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:11:12.428720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ffbcc-cebd-4a76-a749-a274c910d8c8 None admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:11:12.460762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:11:12.461431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:11:12.461712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:11:12.461984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:11:12.462718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:11:12.464072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c187afea-3853-4fec-bb8e-1a9cabe16c20 None admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:11:12.537267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 649/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Tue Jul 12 07:11:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:11:22.320754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=30 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:11:22.532625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:08.348782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e93a3-f4a8-40b0-a72a-0830ea2ae581 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:08.349397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e93a3-f4a8-40b0-a72a-0830ea2ae581 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:08.349397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e93a3-f4a8-40b0-a72a-0830ea2ae581 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:08.350809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 658/1307] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:08.356247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033867c0-15ff-4f5f-9886-348975709d6a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:08.356730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033867c0-15ff-4f5f-9886-348975709d6a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:08.356814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033867c0-15ff-4f5f-9886-348975709d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:08.505658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-033867c0-15ff-4f5f-9886-348975709d6a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:08.507343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-033867c0-15ff-4f5f-9886-348975709d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:08.665073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 650/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:08.728901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:08.729282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:08.729632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:08.731369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 659/1309] 10.222.0.27 () {54 vars in 964 bytes} [Tue Jul 12 07:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:08.737427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ce08-e688-4af0-902b-36ffa5e955d5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:08.737813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ce08-e688-4af0-902b-36ffa5e955d5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:08.738164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ce08-e688-4af0-902b-36ffa5e955d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:08.859184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5083ce08-e688-4af0-902b-36ffa5e955d5 None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:08.860428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5083ce08-e688-4af0-902b-36ffa5e955d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:08.918661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:09.049718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 651/1310] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Jul 12 07:17:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:09.061592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:09.063930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:09.221253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1968bd-fc6d-448b-a88e-7a3d1301d299 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:09.316512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:09.317203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:09.317488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:09.317766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:09.319479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:09.401256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:09.471090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:09.473042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d69d0-b202-465b-9edc-4750759b8e2d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:09.496957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 660/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:11.858463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:11.861243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:11.861243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:11.861243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 652/1312] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:11.868937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41b23-f335-4a35-a80e-1f6919aa65d4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:11.869502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41b23-f335-4a35-a80e-1f6919aa65d4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:11.869617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de41b23-f335-4a35-a80e-1f6919aa65d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:11.942781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8de41b23-f335-4a35-a80e-1f6919aa65d4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:11.943989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8de41b23-f335-4a35-a80e-1f6919aa65d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:12.041443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 661/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:12.078902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:12.080439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:12.187750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9c9747-f948-4a1f-843b-faee986be030 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:12.258985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:12.261574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:12.262233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:12.262515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:12.262787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:12.264443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:12.371238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:12.372672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287afb32-28b6-4160-9964-d7aa686df535 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:12.390723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 653/1314] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:14.916723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:14.917314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:14.917314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:14.918742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 662/1315] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:14.923889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39affd8-a5ce-4f1c-b2af-8144027cb4d2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:14.927314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39affd8-a5ce-4f1c-b2af-8144027cb4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:14.927314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39affd8-a5ce-4f1c-b2af-8144027cb4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:14.988381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f39affd8-a5ce-4f1c-b2af-8144027cb4d2 None None] MFA Rules not processed for user `3c3b2f254edb4cf1bd1e958c56aa9af6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:14.989627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f39affd8-a5ce-4f1c-b2af-8144027cb4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:15.042310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:15.085183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 654/1316] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:14 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:15.124590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:15.126194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:15.135768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:15.228902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db26d-c322-4812-bfef-44361eab2201 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:15.299397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:15.300034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:15.300313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:15.300583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:15.302240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:15.362285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:15.407454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:15.408864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e0f19-3d71-4b23-932d-b18d5b4fb567 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:15.427156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 663/1317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:18.204736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31035-3522-45e4-b15c-8ea6761a1a65 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:18.205259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31035-3522-45e4-b15c-8ea6761a1a65 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:18.205363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d31035-3522-45e4-b15c-8ea6761a1a65 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:18.206954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 655/1318] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:18.212689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee0f2-84a8-461d-9b4d-7c7e755ecf27 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:18.213130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee0f2-84a8-461d-9b4d-7c7e755ecf27 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:18.213300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1ee0f2-84a8-461d-9b4d-7c7e755ecf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:18.276304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6f1ee0f2-84a8-461d-9b4d-7c7e755ecf27 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:18.277449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6f1ee0f2-84a8-461d-9b4d-7c7e755ecf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:18.372648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 664/1319] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:18.423887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:18.424180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:18.424481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:18.425993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 656/1320] 10.222.0.27 () {54 vars in 964 bytes} [Tue Jul 12 07:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:18.431535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2713e-9845-4539-88ce-c60014238157 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:18.431822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2713e-9845-4539-88ce-c60014238157 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:18.432101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2713e-9845-4539-88ce-c60014238157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:18.452912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:18.506946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ade2713e-9845-4539-88ce-c60014238157 None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:18.508827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ade2713e-9845-4539-88ce-c60014238157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:18.582709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 665/1321] 10.222.0.27 () {58 vars in 1061 bytes} [Tue Jul 12 07:17:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:18.592339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:18.593907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:18.694746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a825e-b687-4d2c-b05e-35a6e26695bc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:18.767958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:18.768612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:18.768891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:18.769197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:18.770825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:18.778214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:18.878445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:18.879820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb4479-0812-4b71-b316-4437f120ed26 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:18.898632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 657/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:22.380027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:22.380530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:22.380530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:22.381913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 666/1323] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:22.387854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f96563-be83-470a-87d9-0e589b507dae None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:22.388276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f96563-be83-470a-87d9-0e589b507dae None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:22.388562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f96563-be83-470a-87d9-0e589b507dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:22.455042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-88f96563-be83-470a-87d9-0e589b507dae None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:22.456568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-88f96563-be83-470a-87d9-0e589b507dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:22.516321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:22.557689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 658/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:22.595371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:22.596934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:22.726102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679da6b-657c-4d55-a46b-70b5dd5566e0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:22.740132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:22.806328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:22.806985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:22.807269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:22.807543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:22.809225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:22.921733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:22.923175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b60510-160b-4be9-98d9-d4674b486a0d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:22.941391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 667/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:25.040105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:25.040628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:25.040721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:25.042065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 659/1326] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:25.047360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943264-c53b-4ba9-8066-a8a31076220b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:25.047865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943264-c53b-4ba9-8066-a8a31076220b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:25.047960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b943264-c53b-4ba9-8066-a8a31076220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:25.095833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:25.113589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1b943264-c53b-4ba9-8066-a8a31076220b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:25.114792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1b943264-c53b-4ba9-8066-a8a31076220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:25.211822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 668/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:25.247375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:25.248914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:25.351196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135e4f89-f4c7-4dc5-a455-94b5f7afc67c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:25.424134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:25.424782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:25.425093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:25.425370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:25.427016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:25.443942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:25.542609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:25.544056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793b6ee2-0e36-45f6-bc0c-f6df0b330fde service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:25.563255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 660/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:27.647537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:27.648064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:27.648064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:27.650076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 669/1329] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:27.655319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c5139-7d54-42f8-b5ae-98ef83769491 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:27.655774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c5139-7d54-42f8-b5ae-98ef83769491 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:27.655886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c5139-7d54-42f8-b5ae-98ef83769491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:27.720723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b29c5139-7d54-42f8-b5ae-98ef83769491 None None] MFA Rules not processed for user `3c3b2f254edb4cf1bd1e958c56aa9af6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:27.721936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b29c5139-7d54-42f8-b5ae-98ef83769491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:27.788159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:27.822567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 661/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:27.861174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:27.862730 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:27.978053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5191b980-2837-48d9-a1f6-79eeeda6c8a9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:27.997857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:28.050751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:28.051321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:28.051605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:28.051880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:28.053539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:28.165173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:28.166746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa193c4b-aa26-433a-acb3-a8948912d4d6 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:28.190239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 670/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:30.642280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:30.642782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:30.642782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:30.644158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 662/1332] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:30.649406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9066-11c5-45c0-8f8f-d02093471c6e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:30.649856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9066-11c5-45c0-8f8f-d02093471c6e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:30.649956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f9066-11c5-45c0-8f8f-d02093471c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:30.712419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:30.715194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-140f9066-11c5-45c0-8f8f-d02093471c6e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:30.716388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-140f9066-11c5-45c0-8f8f-d02093471c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:30.813070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 671/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:30.849213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:30.850751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:30.953704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dff170-9402-487d-8ce0-6444312a9af1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:31.027146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:31.027790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:31.028074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:31.028348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:31.030029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:31.056887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:31.137894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:31.139327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1f86c-6178-46ff-8cba-9b88564aac9a service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:31.157393 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 663/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:33.234220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:33.234742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:33.234742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:33.236082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 672/1335] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:33.241052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6b37-256f-4f1a-8f0d-325f2eb10ddb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:33.241477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6b37-256f-4f1a-8f0d-325f2eb10ddb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:33.241613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c6b37-256f-4f1a-8f0d-325f2eb10ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:33.304169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-384c6b37-256f-4f1a-8f0d-325f2eb10ddb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:33.305430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-384c6b37-256f-4f1a-8f0d-325f2eb10ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:33.378262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:33.400964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 664/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:33.439519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:33.441102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:33.543383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa5b2b-ee98-438e-818b-313802f0f212 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:33.570957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:33.615423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:33.616055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:33.616334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:33.616604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:33.618290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:33.724069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:33.725525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb543aa-6dbf-40c1-b2b8-a7aed0bd8884 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:33.744293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 673/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:36.430225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:36.430759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:36.430759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:36.432140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 665/1338] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:36.438404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218c1dc-df0c-42de-aac1-4db2476548dd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:36.438856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218c1dc-df0c-42de-aac1-4db2476548dd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:36.438968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218c1dc-df0c-42de-aac1-4db2476548dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:36.506539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1218c1dc-df0c-42de-aac1-4db2476548dd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:36.508252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1218c1dc-df0c-42de-aac1-4db2476548dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:36.517804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:36.621191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 674/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:36.662874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:36.664824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:36.776919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af1c94-f71e-4713-b4d7-db83ada0e877 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:36.859502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:36.864245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:36.864245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:36.864245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:36.864245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:36.906833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:36.987223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:36.988660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba235-d023-4357-83c9-b9560ce6e731 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:37.009331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 666/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:41.145578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:41.146107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:41.146107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:41.147604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 675/1341] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:41.153463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8cdf-626a-4ddb-b25d-57becdd600b6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:41.153911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8cdf-626a-4ddb-b25d-57becdd600b6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:41.154010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c8cdf-626a-4ddb-b25d-57becdd600b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:41.228139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ef3c8cdf-626a-4ddb-b25d-57becdd600b6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:41.228139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ef3c8cdf-626a-4ddb-b25d-57becdd600b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:41.319863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:41.333569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 667/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:41.372069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:41.373635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:41.481203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede848c-0424-4f14-958b-a7ab9564af07 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:41.519292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:41.556505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:41.557209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:41.557498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:41.557772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:41.559478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:41.668010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:41.669489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d5597-048b-474e-a76e-3061e08c8ef2 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:41.688331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 676/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:44.847124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:44.847655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:44.847655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:44.849090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 668/1344] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:44.854539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c09b-c8f4-4f49-988f-496d46bd8b5c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:44.855013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c09b-c8f4-4f49-988f-496d46bd8b5c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:44.855128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b9c09b-c8f4-4f49-988f-496d46bd8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:44.919346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b5b9c09b-c8f4-4f49-988f-496d46bd8b5c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:44.920537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b5b9c09b-c8f4-4f49-988f-496d46bd8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:44.938194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:45.019039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 677/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:45.056237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:45.057849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:45.160953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f844ec27-ac3d-4ea7-949c-708c73e63f4d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:45.237379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:45.238038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:45.238318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:45.238590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:45.240336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:45.286996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:45.353777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:45.355215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb79f47-f075-47df-8920-4aba81004bc3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:45.373435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 669/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:45 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:49.852535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:49.853100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:49.853366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:49.854524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 678/1347] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:17:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:49.860327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418979-7dba-44bf-bc7c-da8d63e2d290 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:49.864354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418979-7dba-44bf-bc7c-da8d63e2d290 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:49.864354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02418979-7dba-44bf-bc7c-da8d63e2d290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:49.933545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-02418979-7dba-44bf-bc7c-da8d63e2d290 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:49.934790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-02418979-7dba-44bf-bc7c-da8d63e2d290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:50.039024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:50.041600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 670/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:50.079953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:17:50.081946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:50.193078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835551f-fe90-47eb-944d-d90d578bd299 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:17:50.244059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:50.271656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:17:50.272513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:50.273512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:50.274132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:50.275790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:50.384770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:17:50.386259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73c662-05b3-4133-a547-3d9839634c9b service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:17:50.405460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 679/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:17:55.383966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4fa7-1ad7-4b65-9ec5-d43f4c2ea837 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:55.384470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4fa7-1ad7-4b65-9ec5-d43f4c2ea837 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:55.384549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e4fa7-1ad7-4b65-9ec5-d43f4c2ea837 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:55.389507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 671/1350] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:17:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:55.401921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d073-807d-431a-b1fb-fab5b520fe31 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:55.402435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d073-807d-431a-b1fb-fab5b520fe31 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:55.402704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0d073-807d-431a-b1fb-fab5b520fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:55.505115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b0a0d073-807d-431a-b1fb-fab5b520fe31 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:55.506412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b0a0d073-807d-431a-b1fb-fab5b520fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:55.527688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:55.632358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 680/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:17:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:17:59.672890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a749d-8c4e-4eb2-9f04-ab55f0fc9256 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:59.673923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a749d-8c4e-4eb2-9f04-ab55f0fc9256 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:59.674453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a749d-8c4e-4eb2-9f04-ab55f0fc9256 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:59.675989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 672/1352] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:17:59.681413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c572fc-fc16-41a9-851c-9b93d4a745f0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:17:59.681861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c572fc-fc16-41a9-851c-9b93d4a745f0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:17:59.681955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c572fc-fc16-41a9-851c-9b93d4a745f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:17:59.759614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-19c572fc-fc16-41a9-851c-9b93d4a745f0 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:17:59.760797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-19c572fc-fc16-41a9-851c-9b93d4a745f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:17:59.835749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:17:59.873591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 681/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:17:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:01.447135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163c91-c579-41ea-8df5-068f35e24eaa None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:01.447670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163c91-c579-41ea-8df5-068f35e24eaa None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:01.447777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0163c91-c579-41ea-8df5-068f35e24eaa None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:01.449098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 673/1354] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:01.454449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ad136-bc59-47e8-aa5b-315fd4fe504d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:01.454861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ad136-bc59-47e8-aa5b-315fd4fe504d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:01.455016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ad136-bc59-47e8-aa5b-315fd4fe504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:01.531043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-580ad136-bc59-47e8-aa5b-315fd4fe504d None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:01.532237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-580ad136-bc59-47e8-aa5b-315fd4fe504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:01.637400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 682/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:18:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:18:05.102806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695c2e-12b1-4129-8d94-db46dab5945e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:05.105519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695c2e-12b1-4129-8d94-db46dab5945e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:05.111326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80695c2e-12b1-4129-8d94-db46dab5945e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:05.111326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 674/1356] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:05.113595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1843-6cfa-4470-9f81-08898223c96f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:05.114044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1843-6cfa-4470-9f81-08898223c96f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:05.115919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e1843-6cfa-4470-9f81-08898223c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:05.170930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:05.204713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b13e1843-6cfa-4470-9f81-08898223c96f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:05.205925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b13e1843-6cfa-4470-9f81-08898223c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:05.321475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 683/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:05.375640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:05.376301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:05.376815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:05.378866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 675/1358] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 12 07:18:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:05.395049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155bd39-0bdd-40d3-8497-9a7a9227d68f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:05.395680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155bd39-0bdd-40d3-8497-9a7a9227d68f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:05.396405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155bd39-0bdd-40d3-8497-9a7a9227d68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:05.494675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4155bd39-0bdd-40d3-8497-9a7a9227d68f None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:05.495918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4155bd39-0bdd-40d3-8497-9a7a9227d68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:05.549715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:05.621139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 684/1359] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 12 07:18:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:05.628706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:05.630223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:05.780578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c8ac-2bec-409b-a29f-30b4a67cacf6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:05.869894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:05.907968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:05.908805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:05.909250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:05.909622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:05.911425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:06.024284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:06.025922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70763-1025-48b4-80d5-05aacf21e5e0 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:06.045176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 676/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:08.308908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:08.309515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:08.309515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:08.311041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 685/1361] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:08.316339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1155f-7654-4517-bfc6-832c4fb80015 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:08.316803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1155f-7654-4517-bfc6-832c4fb80015 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:08.316907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1155f-7654-4517-bfc6-832c4fb80015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:08.385329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3da1155f-7654-4517-bfc6-832c4fb80015 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:08.386538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3da1155f-7654-4517-bfc6-832c4fb80015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:08.425979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:08.488532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 677/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:08.532828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:08.534422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:08.704552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a8d0-2e37-40d5-bacc-72d7affd673c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:08.715287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:08.865615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:08.866891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:08.866891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:08.867082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:08.868950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:08.977490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:08.979109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ac2fe-1226-4d1b-82a8-6377159fa5dc service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:09.001441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 686/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:11.502356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55299a-9efb-48f6-bc4d-38dda43a6135 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:11.502912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55299a-9efb-48f6-bc4d-38dda43a6135 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:11.502912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55299a-9efb-48f6-bc4d-38dda43a6135 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:11.504267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 678/1364] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:11.510594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0feee-d950-47f4-9bf5-4c6f942c8497 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:11.511067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0feee-d950-47f4-9bf5-4c6f942c8497 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:11.511150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0feee-d950-47f4-9bf5-4c6f942c8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:11.526382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:11.580782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ecc0feee-d950-47f4-9bf5-4c6f942c8497 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:11.582297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ecc0feee-d950-47f4-9bf5-4c6f942c8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:11.683386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 687/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:11.731220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:11.732007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:11.732673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:11.734231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 679/1366] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 12 07:18:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:11.739682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517b61-0e55-4cc2-881c-c7b6221e8742 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:11.740347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517b61-0e55-4cc2-881c-c7b6221e8742 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:11.740738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4517b61-0e55-4cc2-881c-c7b6221e8742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:11.822078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f4517b61-0e55-4cc2-881c-c7b6221e8742 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:11.823469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f4517b61-0e55-4cc2-881c-c7b6221e8742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:11.870135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:11.960612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 688/1367] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 12 07:18:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:11.971991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:11.974541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:12.134651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50e377-8370-4e66-b856-45d26a95240f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:12.156840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:12.260970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:12.261727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:12.262018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:12.262297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:12.263971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:12.366048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:12.368448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c3fe-760e-493f-b189-3a610fc76745 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:12.389157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 680/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:13.316544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2771c-4384-4cfa-8883-8f5219d97d8d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:13.317075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2771c-4384-4cfa-8883-8f5219d97d8d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:13.317075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2771c-4384-4cfa-8883-8f5219d97d8d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:13.318619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 689/1369] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:13.323745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f96e-5892-41a8-87fe-a6882a0ad33e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:13.324155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f96e-5892-41a8-87fe-a6882a0ad33e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:13.324346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845f96e-5892-41a8-87fe-a6882a0ad33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:13.358112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:13.394806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4845f96e-5892-41a8-87fe-a6882a0ad33e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:13.396066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4845f96e-5892-41a8-87fe-a6882a0ad33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:13.498775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 681/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:13.846638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:13.846638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:13.846638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:13.848561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 690/1371] 10.222.0.27 () {54 vars in 963 bytes} [Tue Jul 12 07:18:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:13.853055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b4fd-72b1-4475-89fa-8ba7aa964c60 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:13.853343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b4fd-72b1-4475-89fa-8ba7aa964c60 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:13.853624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7b4fd-72b1-4475-89fa-8ba7aa964c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:13.935772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0fe7b4fd-72b1-4475-89fa-8ba7aa964c60 None None] MFA Rules not processed for user `aa4c9120fd7344858fb5054d32faed64`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:13.937404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0fe7b4fd-72b1-4475-89fa-8ba7aa964c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:13.990624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:14.023077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 682/1372] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Jul 12 07:18:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:14.030836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:14.032349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:14.143734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1389e-5840-4c4d-8901-445abf8b6d35 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:14.185591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:14.223502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:14.224249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:14.224601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:14.224943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:14.227198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:14.347239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:14.348688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540b4d3-b45a-4adf-8576-41f535485dc4 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:14.369082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 691/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:14.708442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:14.708442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:14.708442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:14.708442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 683/1374] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:14.714100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9ec0-90bd-47bd-950c-90c355e2b047 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:14.714100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9ec0-90bd-47bd-950c-90c355e2b047 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:14.714100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9ec0-90bd-47bd-950c-90c355e2b047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:14.783633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ce2a9ec0-90bd-47bd-950c-90c355e2b047 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:14.784957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ce2a9ec0-90bd-47bd-950c-90c355e2b047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:14.809313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:14.898534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 692/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:14.942673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:14.944209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:15.095245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea52158-d690-47c4-af02-9c618bee41cd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:15.150254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:15.212445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:15.213129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:15.213418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:15.213695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:15.215364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:15.305048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:15.306697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b0f20-6730-459f-80b5-aaf4ed5185f9 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:15.324731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 684/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:17.495786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:17.496313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:17.496313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:17.498082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 693/1377] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:17.503473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746248-4386-48dd-85ab-7308419d4100 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:17.503966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746248-4386-48dd-85ab-7308419d4100 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:17.504062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62746248-4386-48dd-85ab-7308419d4100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:17.571460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-62746248-4386-48dd-85ab-7308419d4100 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:17.572579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-62746248-4386-48dd-85ab-7308419d4100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:17.579769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:17.672154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 685/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:17.716304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:17.717868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:17.879424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f67d1a-99ff-4648-b89c-3d0e15926fe5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:17.883527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:18.148756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:18.149354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:18.149641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:18.149918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:18.151624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:18.247433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:18.249335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ba496-d2f9-41c9-92ad-409032687275 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:18.271360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 694/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:20.475334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:20.476295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:20.476295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:20.477399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 686/1380] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:20.482722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258d77-0a5c-40e6-900d-2cd5d594e6be None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:20.483110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258d77-0a5c-40e6-900d-2cd5d594e6be None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:20.483266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4258d77-0a5c-40e6-900d-2cd5d594e6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:20.494110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:20.548669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4258d77-0a5c-40e6-900d-2cd5d594e6be None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:20.549876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4258d77-0a5c-40e6-900d-2cd5d594e6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:20.652451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 695/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:20.696408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:20.697963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:20.844517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:20.855858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12758f59-b358-4b14-8a3f-6a7c1429aa1f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:20.997128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:20.997809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:20.998092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:20.998373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:21.000167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:21.106638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:21.108149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184eb8-2afa-4731-8df8-48fcaa75ffc7 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:21.119541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:21.129277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 687/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:23.560350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:23.560918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:23.561057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:23.562556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 696/1383] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:23.568245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538d5e-f149-4848-957e-7d38d1b46a5b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:23.568649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538d5e-f149-4848-957e-7d38d1b46a5b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:23.568958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb538d5e-f149-4848-957e-7d38d1b46a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:23.649151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eb538d5e-f149-4848-957e-7d38d1b46a5b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:23.650676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eb538d5e-f149-4848-957e-7d38d1b46a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:23.763982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 688/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:18:23.805894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:23.807425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:23.897988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:23.965617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b6c1c-c6ad-4427-bc96-dd28af31b265 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:24.106420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:24.107105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:24.107406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:24.107695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:24.109566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:24.166342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:24.215864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:24.217950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e318fd2-40ea-4e22-931d-10d66571940f service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:24.242442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 697/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:26.286462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:26.287022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:26.287022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:26.289130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 689/1386] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:26.294860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a044c-6874-47a4-934d-fad6cba403e3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:26.295290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a044c-6874-47a4-934d-fad6cba403e3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:26.295637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a044c-6874-47a4-934d-fad6cba403e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:26.379469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0f6a044c-6874-47a4-934d-fad6cba403e3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:26.380708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f6a044c-6874-47a4-934d-fad6cba403e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:26.481703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 698/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:26.535940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:26.537510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:26.618373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:26.690541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eea82b-607a-4125-95f6-a37826f9b87e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:26.805529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:26.806100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:26.806387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:26.806667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:26.808326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:26.850321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:26.902240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:26.903776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57e82-564d-4825-9610-cb9359dd8769 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:26.921798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 690/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:29.199542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.200096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.200096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.201575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 699/1389] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:29.207084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8faf-b2c9-49c3-8c10-892ae53d5b17 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.207511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8faf-b2c9-49c3-8c10-892ae53d5b17 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.207635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e8faf-b2c9-49c3-8c10-892ae53d5b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.272972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3c9e8faf-b2c9-49c3-8c10-892ae53d5b17 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:29.274113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c9e8faf-b2c9-49c3-8c10-892ae53d5b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:29.370626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 691/1390] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:29.414725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:29.416235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:29.446649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:29.563862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a079f-5144-4714-a8f5-eb6ff4110708 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:29.669286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:29.682606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:29.683259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.683572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.683847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.685532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:29.755603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68e27-e5c4-4fc4-91e8-0e41dae5acd3 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.755891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68e27-e5c4-4fc4-91e8-0e41dae5acd3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.756171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a68e27-e5c4-4fc4-91e8-0e41dae5acd3 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.757627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 692/1391] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:18:29.762477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a7ca-49b1-4ccd-a243-9a8fd6f09a61 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.762969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a7ca-49b1-4ccd-a243-9a8fd6f09a61 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.763132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c582a7ca-49b1-4ccd-a243-9a8fd6f09a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.775267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:29.776872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ea545-caf5-404c-a3f5-f0ed5ada6e02 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:29.777407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:29.795824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 700/1392] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:29.830671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c582a7ca-49b1-4ccd-a243-9a8fd6f09a61 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:29.832048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c582a7ca-49b1-4ccd-a243-9a8fd6f09a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:29.931545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 693/1393] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:18:29.988031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.988318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.988597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:29.990467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 701/1394] 10.222.0.27 () {54 vars in 962 bytes} [Tue Jul 12 07:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:29.997015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc117-dee2-4a95-8d3f-44e31277f879 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:29.998309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc117-dee2-4a95-8d3f-44e31277f879 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:29.998309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cc117-dee2-4a95-8d3f-44e31277f879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:30.085465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fc2cc117-dee2-4a95-8d3f-44e31277f879 None None] MFA Rules not processed for user `8fe3582d28dc473ebf4d7265c331c602`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:30.086616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fc2cc117-dee2-4a95-8d3f-44e31277f879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:30.124461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:30.167526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 694/1395] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Jul 12 07:18:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:30.175007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:30.176507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:30.281041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910d15b-0e7a-4606-ac4b-877779faccdf None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:30.294817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:30.356247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:30.356877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:30.357193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:30.357471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:30.359134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:30.469273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:30.470722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab387-5cfd-4d67-bb03-68922bf81cc0 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:30.488855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 702/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:31.325759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a849a-689a-442e-84d2-475e58df1715 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:31.326259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a849a-689a-442e-84d2-475e58df1715 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:31.326351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a849a-689a-442e-84d2-475e58df1715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:31.390747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7f9a849a-689a-442e-84d2-475e58df1715 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:31.391951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7f9a849a-689a-442e-84d2-475e58df1715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:31.478554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 695/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:18:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:31.521140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:31.521663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:31.521747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:31.523256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 703/1398] 10.222.0.27 () {54 vars in 942 bytes} [Tue Jul 12 07:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:31.529838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330dd-b373-48f0-bba5-ead5d6ff226d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:31.530128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330dd-b373-48f0-bba5-ead5d6ff226d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:31.530407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081330dd-b373-48f0-bba5-ead5d6ff226d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:31.588589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:31.607719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-081330dd-b373-48f0-bba5-ead5d6ff226d None None] MFA Rules not processed for user `f43a49de2754455795ab92ede9138eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:31.608908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-081330dd-b373-48f0-bba5-ead5d6ff226d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:31.714581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 696/1399] 10.222.0.27 () {58 vars in 1039 bytes} [Tue Jul 12 07:18:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:31.723605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:31.725801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:31.769777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:31.861608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a76a6e-52cc-4487-b723-d73216c21e66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:31.967227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:31.967907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:31.968190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:31.968461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:31.970169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:31.999899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:32.050565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682e48-e9b5-44ae-917d-9a823c8a65c7 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:32.050767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682e48-e9b5-44ae-917d-9a823c8a65c7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:32.051194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81682e48-e9b5-44ae-917d-9a823c8a65c7 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:32.052565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 697/1400] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:18:32.054491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:32.056090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:32.057845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec581-f559-4a8c-918c-6c8c41b8fd84 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:32.058129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec581-f559-4a8c-918c-6c8c41b8fd84 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:32.058407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ec581-f559-4a8c-918c-6c8c41b8fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:32.064851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 704/1401] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:18:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:18:32.129093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-198ec581-f559-4a8c-918c-6c8c41b8fd84 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:32.130302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-198ec581-f559-4a8c-918c-6c8c41b8fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:32.186073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:32.227818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 698/1402] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:18:32.271216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:32.272899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:32.367890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d88306-8753-49ed-bbfa-815deef7f2f6 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:32.443570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:32.494002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:32.494655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:32.494936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:32.495208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:32.496883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:32.601066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:32.603611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e17105-4bbf-4952-be56-4817e8c41b00 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:32.641056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 705/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:34.914878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:34.915473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:34.915473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:34.916983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 699/1404] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:34.923464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9896-71aa-4af5-98f6-839ce283936c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:34.923464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9896-71aa-4af5-98f6-839ce283936c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:34.923464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b9896-71aa-4af5-98f6-839ce283936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:35.000471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-745b9896-71aa-4af5-98f6-839ce283936c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:35.001698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-745b9896-71aa-4af5-98f6-839ce283936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:35.043603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:35.118038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 706/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:35.162424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:35.164731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:35.341674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef682c9-4838-44b8-884c-a496f1cff4b2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:35.390001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:35.480301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:35.481007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:35.481424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:35.481921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:35.483866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:35.587275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:35.588945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d88d24-a721-4ca8-8c31-91c59c3542d0 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:35.607943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 700/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:37.879874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:37.880400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:37.880400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:37.885190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 707/1407] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:18:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:37.887906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f844-1ecc-477d-b235-7cc885171e99 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:37.888310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f844-1ecc-477d-b235-7cc885171e99 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:37.888502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2f844-1ecc-477d-b235-7cc885171e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:37.955333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:37.964513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-97a2f844-1ecc-477d-b235-7cc885171e99 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:37.968534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-97a2f844-1ecc-477d-b235-7cc885171e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:38.076386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 701/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:18:38.121445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:38.123041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:38.286753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca71b2-a997-4d1e-8152-075185c017f3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:38.305871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:38.406856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:38.407511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:38.407794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:38.408070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:38.409781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:38.527714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:38.529738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5326864-bfeb-446c-aea9-8667e41d5378 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:38.564955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 708/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:18:48.074341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=44 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:48.562119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:55.697366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fa68d-4c38-4d81-b650-cdaef767e99c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:55.697942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fa68d-4c38-4d81-b650-cdaef767e99c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:55.698042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fa68d-4c38-4d81-b650-cdaef767e99c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:55.699374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 702/1410] 10.222.0.27 () {54 vars in 918 bytes} [Tue Jul 12 07:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:55.704867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fd20-6702-417a-b042-578e878a88b3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:55.705350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fd20-6702-417a-b042-578e878a88b3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:55.705468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0fd20-6702-417a-b042-578e878a88b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:55.780430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-98d0fd20-6702-417a-b042-578e878a88b3 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:55.781654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-98d0fd20-6702-417a-b042-578e878a88b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:55.887268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 709/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 12 07:18:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:55.901495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8212f-3eaa-4e26-89ca-bcafbbf9acdb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:55.901784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8212f-3eaa-4e26-89ca-bcafbbf9acdb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:55.902064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8212f-3eaa-4e26-89ca-bcafbbf9acdb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:55.903404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 703/1412] 10.222.0.27 () {54 vars in 918 bytes} [Tue Jul 12 07:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:55.907850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5221c-1e6b-434e-983f-a5825dcb762d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:55.908139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5221c-1e6b-434e-983f-a5825dcb762d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:55.908417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5221c-1e6b-434e-983f-a5825dcb762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:55.979519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:55.982086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-56e5221c-1e6b-434e-983f-a5825dcb762d None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:55.983268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-56e5221c-1e6b-434e-983f-a5825dcb762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:56.102930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 710/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Tue Jul 12 07:18:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:58.597921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:58.598446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:58.598446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:58.599754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:18:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:18:58.605359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e3ae-f046-4e12-8234-ea352c7e9f05 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:58.605831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e3ae-f046-4e12-8234-ea352c7e9f05 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:58.605934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed60e3ae-f046-4e12-8234-ea352c7e9f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:58.669512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ed60e3ae-f046-4e12-8234-ea352c7e9f05 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:18:58.670701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ed60e3ae-f046-4e12-8234-ea352c7e9f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:58.724869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:58.767938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:18:58.810302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:18:58.811821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:58.955093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec8dc6-65aa-4354-9203-a8d54e6f2319 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:18:59.026615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:18:59.067370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:18:59.068012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:18:59.068293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:18:59.068566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:18:59.070306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:18:59.157626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:18:59.159208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f860-5a04-4554-ac88-2f618a1885ca service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:18:59.177944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 705/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:00.085614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:00.086138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:00.086138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:00.087532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:00.092304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8ec-0c31-4840-90ff-5642e0e5aa39 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:00.092745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8ec-0c31-4840-90ff-5642e0e5aa39 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:00.092847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486a8ec-0c31-4840-90ff-5642e0e5aa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:00.166017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7486a8ec-0c31-4840-90ff-5642e0e5aa39 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:00.167389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7486a8ec-0c31-4840-90ff-5642e0e5aa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:00.195051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:00.264893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:00.415767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:00.417312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:00.562642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a79a08-ee8b-4a89-bbe0-448c1b14caa5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:00.602014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:00.672646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:00.673337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:00.673624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:00.673929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:00.675580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:00.764152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:00.765798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacab29e-f1e0-4eec-983c-242ad53c1cb8 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:00.784060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 713/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:01.663214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:01.663803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:01.663803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:01.665245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:01.670167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587b46-b0c9-42ca-ba0a-06a41f16b55a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:01.670563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587b46-b0c9-42ca-ba0a-06a41f16b55a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:01.670796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a587b46-b0c9-42ca-ba0a-06a41f16b55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:01.723613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:01.745661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8a587b46-b0c9-42ca-ba0a-06a41f16b55a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:01.746872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8a587b46-b0c9-42ca-ba0a-06a41f16b55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:01.843492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:01.996424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:01.997970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:02.142815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d8f3-feed-4591-8426-ba7de40b695e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:02.154833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:02.255102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:02.255747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:02.256027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:02.256307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:02.257967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:02.345044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:02.346630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47130218-8d00-4b37-b766-bfb4041639d4 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:02.364950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 708/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:03.211073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:03.211603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:03.211603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:03.212994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:03.217811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e656beb-1296-4a62-a2f0-234ecc5c6054 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:03.218203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e656beb-1296-4a62-a2f0-234ecc5c6054 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:03.218377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e656beb-1296-4a62-a2f0-234ecc5c6054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:03.237614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:03.293454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5e656beb-1296-4a62-a2f0-234ecc5c6054 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:03.294638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5e656beb-1296-4a62-a2f0-234ecc5c6054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:03.390806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:03.539713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:03.541218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:03.650109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:03.684334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4000de-f16b-4051-95ed-9afc3883fa49 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:03.795886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:03.796457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:03.796737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:03.797009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:03.798662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:03.873429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:03.886708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:03.888453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f9ee3-74c3-408b-8505-6b51f1699128 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:03.907485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 716/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:04.768822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:04.769505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:04.769505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:04.770783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:04.776065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ad52-305e-4a4c-80db-5974512df523 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:04.776468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ad52-305e-4a4c-80db-5974512df523 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:04.776621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51ad52-305e-4a4c-80db-5974512df523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:04.849012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4f51ad52-305e-4a4c-80db-5974512df523 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:04.850268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4f51ad52-305e-4a4c-80db-5974512df523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:04.956967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:05.110274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:05.111715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:05.196793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:05.260322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ed6b8-db39-4873-ac4b-9f2c918a277c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:05.375592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:05.376154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:05.376436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:05.376711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:05.378367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:05.425691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:05.466465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:05.468102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bfcbd-274a-45b1-8c8b-a8cb01cefb9a service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:05.486339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 711/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:06.356459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:06.357012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:06.357012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:06.358466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:06.363578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679fb2-811e-449b-b618-e5113817357a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:06.364004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679fb2-811e-449b-b618-e5113817357a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:06.364133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca679fb2-811e-449b-b618-e5113817357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:06.438510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ca679fb2-811e-449b-b618-e5113817357a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:06.439689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ca679fb2-811e-449b-b618-e5113817357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:06.535279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:06.689133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:06.690976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:06.739715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:06.837470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e39cbd-fa98-436c-8d72-bc30e6b71c7d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:06.952449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:06.952449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:06.952449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:06.952449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:06.952941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:06.959280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:07.041994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:07.043580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf57884-87d5-4942-aeb3-bebfe26c83b0 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:07.062393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 719/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:07.937613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:07.938138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:07.938258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:07.939597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:07.944735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd8d2-4bd2-441c-b03d-f8b39c7ca793 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:07.945197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd8d2-4bd2-441c-b03d-f8b39c7ca793 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:07.945326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8edd8d2-4bd2-441c-b03d-f8b39c7ca793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:08.019516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d8edd8d2-4bd2-441c-b03d-f8b39c7ca793 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:08.020719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d8edd8d2-4bd2-441c-b03d-f8b39c7ca793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:08.087944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:08.117746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:08.269353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:08.270900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:08.289382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:08.416173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e08b28-59e2-452d-89b4-bfc3159e246a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:08.503188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:08.529589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:08.530242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:08.530528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:08.530805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:08.532487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:08.624024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:08.625656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c33d7-d71c-40bc-ab5e-b6ad8f8d374b service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:08.644456 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 714/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:09.498122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:09.498706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:09.498706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:09.500048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:09.504877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d2018-d834-4c19-a884-d96f32d1fc91 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:09.505291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d2018-d834-4c19-a884-d96f32d1fc91 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:09.505477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17d2018-d834-4c19-a884-d96f32d1fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:09.578947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f17d2018-d834-4c19-a884-d96f32d1fc91 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:09.580190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f17d2018-d834-4c19-a884-d96f32d1fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:09.623915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:09.678113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:09.828568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:09.830054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:09.978514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd6e70-87fc-4d44-9fa6-ac223c376b0d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:10.033042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:10.092281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:10.092857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:10.093176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:10.093449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:10.095094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:10.183243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:10.184836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7feb82f-2fbc-4448-953a-3a3d426b70de service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:10.202949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 722/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:11.054494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:11.055072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:11.055072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:11.056434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:11.061563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28bdf0-ef93-4a01-8514-0a05b102b0c6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:11.061982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28bdf0-ef93-4a01-8514-0a05b102b0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:11.062117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28bdf0-ef93-4a01-8514-0a05b102b0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:11.136846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dd28bdf0-ef93-4a01-8514-0a05b102b0c6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:11.138090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd28bdf0-ef93-4a01-8514-0a05b102b0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:11.140082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:11.237438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:11.391674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:11.393220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:11.536155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28855921-0577-485b-b7ff-bf0d6fe73485 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:11.562803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:11.648253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:11.648890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:11.649206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:11.649482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:11.651118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:11.738726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:11.740325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b68b55-8980-4b82-a9c7-3c88d96cc154 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:11.758567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 717/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:13.663407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:13.663963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:13.663963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:13.665355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:13.670461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe29e-74bd-4ff0-9ad5-f271a5bbc4b8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:13.670853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe29e-74bd-4ff0-9ad5-f271a5bbc4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:13.671085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fe29e-74bd-4ff0-9ad5-f271a5bbc4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:13.711206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:13.735561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-412fe29e-74bd-4ff0-9ad5-f271a5bbc4b8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:13.736777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-412fe29e-74bd-4ff0-9ad5-f271a5bbc4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:13.834995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:13.873567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:13.875107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:13.979036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f916630-84d7-4310-88b9-ad2dcb10e00c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:14.011009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:14.052091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:14.052743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:14.053051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:14.053332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:14.055089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:14.161439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:14.162898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ccfba-529b-4c4c-af91-2c1788c66c55 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:14.180954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 725/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:16.359620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:16.360148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:16.360148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:16.361596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:16.367477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd558-ce3c-4baf-b6fe-56fb11c1cc63 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:16.367899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd558-ce3c-4baf-b6fe-56fb11c1cc63 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:16.368004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffd558-ce3c-4baf-b6fe-56fb11c1cc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:16.431373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-41ffd558-ce3c-4baf-b6fe-56fb11c1cc63 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:16.432576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-41ffd558-ce3c-4baf-b6fe-56fb11c1cc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:16.445284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:16.530817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:16.570291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:16.571845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:16.674286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88385d6-0e23-4029-a2c8-ef54ec1622cf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:16.687554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:16.749744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:16.750384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:16.750665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:16.750938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:16.752601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:16.861690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:16.863094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2c242-03b0-4697-9509-c76b3814c71e service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:16.882110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 720/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:19.290105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:19.290621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:19.290621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:19.291946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:19.297264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6664-708b-4684-a53d-97e1e05e2d04 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:19.297687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6664-708b-4684-a53d-97e1e05e2d04 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:19.297834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f6664-708b-4684-a53d-97e1e05e2d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:19.346426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:19.364321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ea4f6664-708b-4684-a53d-97e1e05e2d04 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:19.368455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ea4f6664-708b-4684-a53d-97e1e05e2d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:19.464836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:19:19.503134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:19.504665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:19.606049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b013-8ea0-4914-8d5f-ded7f7602f82 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:19.646317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:19.680257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:19.680906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:19.681213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:19.681490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:19.683130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:19.789845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:19.791278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e7583-4dcb-42f4-ae0d-184bbc6043e7 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:19.809894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 728/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:22.027824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:22.028319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:22.028434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:22.029798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:22.035211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd3b8-eb73-4876-9299-6b73bf468941 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:22.035592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd3b8-eb73-4876-9299-6b73bf468941 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:22.035764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd3b8-eb73-4876-9299-6b73bf468941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:22.101477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-df1dd3b8-eb73-4876-9299-6b73bf468941 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:22.102696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df1dd3b8-eb73-4876-9299-6b73bf468941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:22.123472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:22.200191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:22.238920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:22.240494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:22.343833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc857c-2cad-4462-9e69-643cc5f1ccbb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:22.362934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:22.416013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:22.416659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:22.416938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:22.417238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:22.418871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:22.525104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:22.526468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22ea2ad-6349-4be8-b0c7-e359dc2a56a6 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:22.544043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 723/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:24.638289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:24.638835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:24.638835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:24.640228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:24.645475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b2562-8b31-4336-81fc-ab88dc7a6394 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:24.645908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b2562-8b31-4336-81fc-ab88dc7a6394 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:24.646035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b2562-8b31-4336-81fc-ab88dc7a6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:24.707165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:24.710630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cc9b2562-8b31-4336-81fc-ab88dc7a6394 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:24.711812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cc9b2562-8b31-4336-81fc-ab88dc7a6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:24.807629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:24.845699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:24.847217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:24.951172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82c78b-442f-4f8a-b59a-16b3522c8b59 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:25.000289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:25.025664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:25.026317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:25.026600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:25.026876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:25.028522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:25.135405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:25.136824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37ae06-1a36-4dc7-a359-0a6dc90bef87 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:25.154671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 731/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:27.218401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:27.218966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:27.218966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:27.220375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:27.226298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570525e-e9b7-4d01-b15c-702c838cdd1a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:27.226703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570525e-e9b7-4d01-b15c-702c838cdd1a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:27.226826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570525e-e9b7-4d01-b15c-702c838cdd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:27.290636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6570525e-e9b7-4d01-b15c-702c838cdd1a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:27.291833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6570525e-e9b7-4d01-b15c-702c838cdd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:27.319837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:27.387060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:27.423791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:27.425354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:27.529903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24c13b-2dc9-484a-b3e2-7014e8b43c5c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:27.557487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:27.604119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:27.604765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:27.605069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:27.605349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:27.606977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:27.712502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:27.713962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a8771-aa40-4c5a-bec5-de4c47b3d178 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:27.732439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 726/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:29.811958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:29.812524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:29.812524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:29.813940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:29.819752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a6a3-3263-494c-823d-724aa11816c9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:29.820170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a6a3-3263-494c-823d-724aa11816c9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:29.820295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0a6a3-3263-494c-823d-724aa11816c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:29.884692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d7b0a6a3-3263-494c-823d-724aa11816c9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:29.885924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d7b0a6a3-3263-494c-823d-724aa11816c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:29.894178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:29.982594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:30.020101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:30.021793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:30.132309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6f2181-9af1-4207-b3b4-4b2853e02128 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:30.186250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:30.205062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:30.205714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:30.205999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:30.206275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:30.208299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:30.314318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:30.315752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60429dc-6ad5-4400-8b7a-ccd6972fc34d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:30.334929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 734/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:32.410238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:32.410802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:32.411058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:32.413070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:32.418289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88583-706d-4b05-96b5-5c8beb7c77ae None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:32.418713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88583-706d-4b05-96b5-5c8beb7c77ae None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:32.418826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a88583-706d-4b05-96b5-5c8beb7c77ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:32.482213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-14a88583-706d-4b05-96b5-5c8beb7c77ae None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:32.483399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-14a88583-706d-4b05-96b5-5c8beb7c77ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:32.520028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:32.577399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:32.614541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:32.616590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:32.722550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601b66-8bfb-4055-a7f6-bd97a3ca8f20 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:32.760457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:32.797613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:32.798195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:32.798482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:32.798764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:32.800408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:32.910072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:32.911496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20ce1-e2d4-4deb-a833-6ab722d649f2 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:32.930339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 729/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:35.000147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:35.000666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:35.009384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:35.009384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:35.009594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662d7d-1d55-410a-b9ba-cbf5206801de None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:35.009594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662d7d-1d55-410a-b9ba-cbf5206801de None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:35.009594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6662d7d-1d55-410a-b9ba-cbf5206801de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:35.073688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d6662d7d-1d55-410a-b9ba-cbf5206801de None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:35.074898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d6662d7d-1d55-410a-b9ba-cbf5206801de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:35.093204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:35.172032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:35.208826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:35.211056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:35.314738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e208cb5-7417-48a8-b618-303506030ba0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:35.382712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:35.389251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:35.389926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:35.390220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:35.390477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:35.392129 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:35.501800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:35.503241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d685f9-0d6f-4ce2-b21e-9ad5cfd746b0 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:35.521904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 737/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:37.650625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:37.651213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:37.651213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:37.652613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:37.658080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cc938-7f3a-4779-b1ad-b3895e8159c4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:37.658513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cc938-7f3a-4779-b1ad-b3895e8159c4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:37.658668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cc938-7f3a-4779-b1ad-b3895e8159c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:37.724043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f41cc938-7f3a-4779-b1ad-b3895e8159c4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:37.725856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f41cc938-7f3a-4779-b1ad-b3895e8159c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:37.774266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:37.823369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:37.860790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:37.866657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:37.966716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a024d-e1be-48da-bf72-7f71f4edbe8c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:38.015626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:38.042434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:38.042730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:38.043013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:38.043287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:38.044930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:38.152036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:38.153497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec092381-d69f-4e80-b2ea-0e60b2228d6a service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:38.173184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 732/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:19:47.821567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=22 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:48.170918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=66 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:57.930526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00834e-2a02-48d9-85e6-1ff25b32aae3 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:57.931132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00834e-2a02-48d9-85e6-1ff25b32aae3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:57.931132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00834e-2a02-48d9-85e6-1ff25b32aae3 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:57.932513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 739/1471] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:57.937811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae3827-d5a8-4784-ba50-91dd79eb5b9f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:57.938241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae3827-d5a8-4784-ba50-91dd79eb5b9f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:57.938428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aae3827-d5a8-4784-ba50-91dd79eb5b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:58.004184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7aae3827-d5a8-4784-ba50-91dd79eb5b9f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:58.005471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7aae3827-d5a8-4784-ba50-91dd79eb5b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:58.101176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 733/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:58.184278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:58.184492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:58.184769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:58.186196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 740/1473] 10.222.0.27 () {54 vars in 962 bytes} [Tue Jul 12 07:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:19:58.191117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c8fc-cd6a-4aa7-ab1e-4be26f8547c5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:58.191404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c8fc-cd6a-4aa7-ab1e-4be26f8547c5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:58.191675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960c8fc-cd6a-4aa7-ab1e-4be26f8547c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:58.266346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e960c8fc-cd6a-4aa7-ab1e-4be26f8547c5 None None] MFA Rules not processed for user `8fe3582d28dc473ebf4d7265c331c602`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:19:58.267537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e960c8fc-cd6a-4aa7-ab1e-4be26f8547c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:58.288750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:58.344332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 734/1474] 10.222.0.27 () {58 vars in 1059 bytes} [Tue Jul 12 07:19:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:19:58.351978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:19:58.353522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:58.455076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddcea0-e4d6-46e1-8e91-bb832c617681 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:19:58.528086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:19:58.528731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:19:58.529013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:19:58.529319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:19:58.530949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:19:58.585295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:19:58.638468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:19:58.639893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7c719-1f8d-4a5b-a851-c0f2eb127d61 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:19:58.658556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 741/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:20:00.746500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:00.747077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:00.747077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:00.748434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 735/1476] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:00.753755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb06d-a5b2-492b-b46d-756ab7b3c57f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:00.754153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb06d-a5b2-492b-b46d-756ab7b3c57f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:00.754314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bb06d-a5b2-492b-b46d-756ab7b3c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:00.819201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c48bb06d-a5b2-492b-b46d-756ab7b3c57f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:00.820410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c48bb06d-a5b2-492b-b46d-756ab7b3c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:00.919593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 742/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:00.942202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:00.943988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:01.072486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a14e5-10fc-4502-af67-75f73b9d1db9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:01.126106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:01.174788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:01.175447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:01.175728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:01.176002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:01.176727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:01.178766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:20:01.178766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:20:01.178766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:20:01.179910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3febb4-b224-43a9-a8b3-b6f9a4279a37 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:01.198927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 736/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Tue Jul 12 07:20:00 2022] GET /identity/v3/projects => generated 2553 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:20:03.251542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:03.252056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:03.252056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:03.253557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 743/1479] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:03.259440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988128a-9fb0-498a-8be6-59e0b21642ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:03.259848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988128a-9fb0-498a-8be6-59e0b21642ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:03.259993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988128a-9fb0-498a-8be6-59e0b21642ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:03.323197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f988128a-9fb0-498a-8be6-59e0b21642ff None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:03.324390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f988128a-9fb0-498a-8be6-59e0b21642ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:03.419652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 737/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:03.463588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:03.465203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:03.475349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:03.610271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8870c-b51c-4419-8454-e0016b56ca33 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:03.687992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:03.720721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:03.721397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:03.721683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:03.721958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:03.723602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:03.812197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:03.813816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad583fed-699e-4ada-857c-33c21730c9c0 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:03.831359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 744/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:20:06.024381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:06.024905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:06.024905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:06.027332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 738/1482] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:06.032760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01706b-85fa-4481-97a3-b581c261bef6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:06.033233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01706b-85fa-4481-97a3-b581c261bef6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:06.033356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01706b-85fa-4481-97a3-b581c261bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:06.097605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6e01706b-85fa-4481-97a3-b581c261bef6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:06.098813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6e01706b-85fa-4481-97a3-b581c261bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:06.144564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:06.195494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 745/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:06.232024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:06.233775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:06.257834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:06.337812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57decf-f31e-4e18-ab76-3715b5676caf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:06.410738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:06.411485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:06.411875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:06.412154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:06.413838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:06.487685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:06.522957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:06.524451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea59333-c1e3-4bed-9788-588d48f60fd2 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:06.543024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 739/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:20:08.653970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:08.654533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:08.654533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:08.655847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 746/1485] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:08.661178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657902c-a6ce-4473-8433-bd2623cc1802 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:08.662437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657902c-a6ce-4473-8433-bd2623cc1802 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:08.662437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657902c-a6ce-4473-8433-bd2623cc1802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:08.727071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5657902c-a6ce-4473-8433-bd2623cc1802 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:08.728277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5657902c-a6ce-4473-8433-bd2623cc1802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:08.825958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 740/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:08.865563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:08.867094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:08.970615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6237f2-3ac9-4ec5-a046-3aac465bdc2a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:09.049654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:09.051381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:09.052654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:09.053182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:09.053344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:09.055006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:09.163090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:09.164528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1b328-8446-40b9-9fa7-870f61783d9d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:09.182629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 747/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:20:11.379339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:11.379873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:11.379873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:11.381269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 741/1488] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:11.386386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d9df-b73c-40ae-b7be-7ac787f05139 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:11.386828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d9df-b73c-40ae-b7be-7ac787f05139 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:11.386974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1d9df-b73c-40ae-b7be-7ac787f05139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:11.451609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-88f1d9df-b73c-40ae-b7be-7ac787f05139 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:11.452810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88f1d9df-b73c-40ae-b7be-7ac787f05139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:11.506043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:11.550531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 748/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:11.590395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:11.591945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:11.627858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:11.695320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1325b3-059f-499b-83d4-1a71505e3b04 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:11.769798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:11.770448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:11.770866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:11.771294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:11.773292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:11.854026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:11.884472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:11.885956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14b4f54-e924-4c92-bc2a-c5437a550c8a service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:11.904483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 742/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:20:14.289862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:14.290328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:14.290437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:14.291826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 749/1491] 10.222.0.27 () {54 vars in 926 bytes} [Tue Jul 12 07:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:20:14.297157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7a50-5d91-4eb0-87c9-1057f70c531f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:14.297562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7a50-5d91-4eb0-87c9-1057f70c531f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:14.297716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f7a50-5d91-4eb0-87c9-1057f70c531f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:14.361726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8f2f7a50-5d91-4eb0-87c9-1057f70c531f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:20:14.362940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8f2f7a50-5d91-4eb0-87c9-1057f70c531f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:14.459708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 743/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Tue Jul 12 07:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:20:14.498236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:20:14.499852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:14.605887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0337e4b-803b-4a38-9ed9-a15ce8ddc009 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:20:14.680294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:20:14.680941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:20:14.681255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:20:14.681535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:20:14.683177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:20:14.692131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:14.793180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:20:14.794609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a178729-9070-4106-a57b-fe07c723ad2e service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:20:14.812565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 750/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:20:24.457467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:20:24.810290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=50 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:11.715801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:11.716400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:11.716400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:11.794587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:22:11.795765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:11.898369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 744/1494] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:22:11.907525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:11.908050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:11.908165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:11.926886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:22:11.928087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:11.937784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 751/1495] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:22:11.952822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:11.962728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f21e-9eb0-42d2-8eab-304c29938ee9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:11.968187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:11.968760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:11.969063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:11.969345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:11.970071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:22:11.970376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:11.971418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:11.971418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:22:11.971418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:22:11.972325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:11.984632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 745/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:22:11.997384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.006479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a04e8-ec56-49cf-94e6-eb688cacb174 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.011918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.012595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.012883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.013206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.013905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.015622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.015622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:22:12.015622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:22:12.016912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.110673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 752/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:22:11 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:22:12.114859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.125128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddb4f-5ad1-4b1b-ae78-f2c5530d87f9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.174468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:12.181007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:22:12.186554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:22:12.187144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.251911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 746/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:22:12 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:22:12.255962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.267104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b6c49-d0fb-4d09-8494-8d0edde9702d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.271716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.272373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.272663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.272943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.273737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.274748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.274748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:22:12.274748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:22:12.275881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.288527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 753/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:22:12.298331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.309058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62291f86-f4d3-4990-bfd0-f97da9453d84 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.313689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.314344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.314630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.314918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.315643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.316751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.316751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:22:12.316751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:22:12.317722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b2e247-b78d-437b-97e2-2d319dbe5a0d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.331559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 747/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:22:12.335795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.345558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acf57d-e0f7-41d9-b3c3-c716ec175e4e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.350127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.350995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.351286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.351570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] PATH_INFO: `/v3/projects/63d04d639a49426fb87aef53af8eb1ab/users/413e43d7ab49421f92275cf7027a5aa5/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.367768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] RBAC: Authorizing `identity:create_grant(project_id=63d04d639a49426fb87aef53af8eb1ab, user_id=413e43d7ab49421f92275cf7027a5aa5, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.368790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.368790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:22:12.368790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:22:12.371323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edc96f-45e4-4cc5-9c79-a32a8edd45db admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.446465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 754/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:22:12 2022] PUT /identity/v3/projects/63d04d639a49426fb87aef53af8eb1ab/users/413e43d7ab49421f92275cf7027a5aa5/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:22:12.459739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7beb2-f295-4419-8968-1664bf5004dc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.460031 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7beb2-f295-4419-8968-1664bf5004dc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.460309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7beb2-f295-4419-8968-1664bf5004dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.487634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4bd7beb2-f295-4419-8968-1664bf5004dc None None] MFA Rules not processed for user `413e43d7ab49421f92275cf7027a5aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:22:12.490185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4bd7beb2-f295-4419-8968-1664bf5004dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:12.672488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 748/1502] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:22:12.686226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc3c7-2956-4f3c-9c3e-514669a69d51 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.686522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc3c7-2956-4f3c-9c3e-514669a69d51 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.686804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbc3c7-2956-4f3c-9c3e-514669a69d51 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.688193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 755/1503] 10.222.0.27 () {54 vars in 963 bytes} [Tue Jul 12 07:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:22:12.692817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7418-37e7-47cf-95f0-1c7e894e1740 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.693133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7418-37e7-47cf-95f0-1c7e894e1740 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.693416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d7418-37e7-47cf-95f0-1c7e894e1740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.751956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-145d7418-37e7-47cf-95f0-1c7e894e1740 None None] MFA Rules not processed for user `aa4c9120fd7344858fb5054d32faed64`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:22:12.753187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-145d7418-37e7-47cf-95f0-1c7e894e1740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:12.832750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 749/1504] 10.222.0.27 () {58 vars in 1060 bytes} [Tue Jul 12 07:22:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:22:12.840680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc3c7-2956-4f3c-9c3e-514669a69d51 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.851479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbc3c7-2956-4f3c-9c3e-514669a69d51 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.856143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.856780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.857098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.857379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.865690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.867109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:12.876939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 756/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:22:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:22:12.918707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb608-5c32-4bae-ad17-1463b7f2a1b6 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.918993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb608-5c32-4bae-ad17-1463b7f2a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.919267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfb608-5c32-4bae-ad17-1463b7f2a1b6 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.920525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 750/1506] 10.222.0.27 () {52 vars in 829 bytes} [Tue Jul 12 07:22:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:22:12.924022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:12.986981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08e568-dc64-41da-ad62-787da3eb2dc5 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:12.991579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:12.992439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:12.992724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:12.992997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] PATH_INFO: `/v3/users/413e43d7ab49421f92275cf7027a5aa5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:12.994376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=413e43d7ab49421f92275cf7027a5aa5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:12.995457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:12.995457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:22:12.995457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:22:12.996648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:13.227148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '413e43d7ab49421f92275cf7027a5aa5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:13.317478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '413e43d7ab49421f92275cf7027a5aa5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:13.335970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '413e43d7ab49421f92275cf7027a5aa5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:13.336616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '413e43d7ab49421f92275cf7027a5aa5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:13.345652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:13.349940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '413e43d7ab49421f92275cf7027a5aa5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:13.356210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 757/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:22:12 2022] DELETE /identity/v3/users/413e43d7ab49421f92275cf7027a5aa5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:22:13.360692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:13.361243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:13.361406 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:13.378509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:22:13.379690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:13.389260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:13.437834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 751/1508] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:22:13.447814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:13.449292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:13.528270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e886c0c-0495-4212-8e8a-213a86692b01 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:13.531825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:13.532470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:13.532753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:13.533039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:13.542394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:13.543842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9db065-a910-425e-a208-f331fd7ecde2 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:13.553327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 758/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:22:13.977000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:22:13.978463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:22:13.990282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ef3a8-bd24-4d83-9eed-769bcac093c8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:22:13.996170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:22:13.997055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:22:13.997355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:22:13.997629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] PATH_INFO: `/v3/projects/63d04d639a49426fb87aef53af8eb1ab` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:22:13.999057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63d04d639a49426fb87aef53af8eb1ab)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:22:14.000155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:22:14.000155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:22:14.000155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:22:14.001337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:22:14.128386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63d04d639a49426fb87aef53af8eb1ab', 'request_id': 'req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:14.212344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63d04d639a49426fb87aef53af8eb1ab', 'request_id': 'req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:14.219014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63d04d639a49426fb87aef53af8eb1ab', 'request_id': 'req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:14.238782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] The token cache is being invalidate because project 63d04d639a49426fb87aef53af8eb1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:22:14.239064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:14.239828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-26b4d51d-2b8d-4a99-bc20-e01282d0b1e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:22:14.241593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 752/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:22:13 2022] DELETE /identity/v3/projects/63d04d639a49426fb87aef53af8eb1ab => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:22:23.549115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=38 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:22:24.235912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:23:55.731457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:55.732066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:55.732066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:55.733435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:23:55.738570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c459ae-72d5-426c-9a03-4f517e63cb3f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:55.738988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c459ae-72d5-426c-9a03-4f517e63cb3f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:55.739135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c459ae-72d5-426c-9a03-4f517e63cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:55.757689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-16c459ae-72d5-426c-9a03-4f517e63cb3f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:23:55.759685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-16c459ae-72d5-426c-9a03-4f517e63cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:23:55.819020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:23:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:23:55.974412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:23:55.976125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:23:56.077925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95ae71-3a94-41a6-94c7-f892b7ef7b95 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:23:56.083281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:23:56.086660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:56.086660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:56.086660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:56.093413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:23:56.095024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e1508b-50ad-48cf-9d95-00a172fe1c90 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:23:56.104194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 760/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:23:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:23:56.977463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df61f-d057-4204-acfc-5b836f6508d8 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:56.977941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df61f-d057-4204-acfc-5b836f6508d8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:56.978049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84df61f-d057-4204-acfc-5b836f6508d8 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:56.979381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:23:56.984238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3e23-1f8d-4246-960d-ccc6968ff320 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:56.984617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3e23-1f8d-4246-960d-ccc6968ff320 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:56.984802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf3e23-1f8d-4246-960d-ccc6968ff320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:57.002798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-eaaf3e23-1f8d-4246-960d-ccc6968ff320 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:23:57.003995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-eaaf3e23-1f8d-4246-960d-ccc6968ff320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:23:57.012857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:23:57.168909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df61f-d057-4204-acfc-5b836f6508d8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:23:57.183472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84df61f-d057-4204-acfc-5b836f6508d8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:23:57.188906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909034ea-b111-4825-8531-93bf5647931c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:23:57.189595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909034ea-b111-4825-8531-93bf5647931c service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:57.189876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909034ea-b111-4825-8531-93bf5647931c service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:57.190191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909034ea-b111-4825-8531-93bf5647931c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:57.198849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909034ea-b111-4825-8531-93bf5647931c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:23:57.200417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909034ea-b111-4825-8531-93bf5647931c service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:23:57.209824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 755/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:23:57.954266 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea26ab2-8018-4de5-a056-5b49046289b1 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:57.954610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea26ab2-8018-4de5-a056-5b49046289b1 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:57.954897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea26ab2-8018-4de5-a056-5b49046289b1 None None] PATH_INFO: `/v3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:57.956403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 762/1517] 10.222.0.36 () {54 vars in 925 bytes} [Tue Jul 12 07:23:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:23:57.963201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d5fe-e2fb-4733-8558-5a2095a4bbb8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:23:57.963473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d5fe-e2fb-4733-8558-5a2095a4bbb8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:23:57.963750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381d5fe-e2fb-4733-8558-5a2095a4bbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:23:58.012857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2381d5fe-e2fb-4733-8558-5a2095a4bbb8 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:23:58.014087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2381d5fe-e2fb-4733-8558-5a2095a4bbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:23:58.091022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 756/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 12 07:23:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:06.998142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=49 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:07.104603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d07a-f3df-4206-a0bb-e80b1e8889fd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:07.104863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d07a-f3df-4206-a0bb-e80b1e8889fd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:07.105172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9d07a-f3df-4206-a0bb-e80b1e8889fd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:07.106592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 763/1519] 10.222.0.27 () {54 vars in 960 bytes} [Tue Jul 12 07:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:07.111569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9522-e85d-4cd2-9abb-fba7216e7f45 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:07.112062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9522-e85d-4cd2-9abb-fba7216e7f45 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:07.112426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e9522-e85d-4cd2-9abb-fba7216e7f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:07.131711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-454e9522-e85d-4cd2-9abb-fba7216e7f45 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:07.133789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-454e9522-e85d-4cd2-9abb-fba7216e7f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:07.142608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 757/1520] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Jul 12 07:24:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:07.150145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d07a-f3df-4206-a0bb-e80b1e8889fd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:07.163650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9d07a-f3df-4206-a0bb-e80b1e8889fd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:07.168857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:07.169558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:07.169845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:07.170123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:07.178298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:07.180470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d779b5-f4aa-4cd6-b593-bb61a9da4fbf service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:07.190069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 764/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:24:08.447357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00606-f61b-4bbc-951d-23b446de7d95 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:08.447832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00606-f61b-4bbc-951d-23b446de7d95 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:08.447930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec00606-f61b-4bbc-951d-23b446de7d95 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:08.449346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:24:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:08.454026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8a69-d227-4daf-89b5-e5ddcd024683 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:08.454446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8a69-d227-4daf-89b5-e5ddcd024683 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:08.454582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d8a69-d227-4daf-89b5-e5ddcd024683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:08.473248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-261d8a69-d227-4daf-89b5-e5ddcd024683 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:08.474445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-261d8a69-d227-4daf-89b5-e5ddcd024683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:08.482975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:08.635548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00606-f61b-4bbc-951d-23b446de7d95 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:08.650362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec00606-f61b-4bbc-951d-23b446de7d95 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:08.655714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:08.656339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:08.656620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:08.656894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:08.665707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:08.667217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42d73a2-a23a-4926-b75c-e7dcf11fff58 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:08.676458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 759/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:09.522088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd938f0-f98a-429a-98d6-9374c3542465 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:09.522651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd938f0-f98a-429a-98d6-9374c3542465 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:09.522651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd938f0-f98a-429a-98d6-9374c3542465 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:09.524090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 07:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:09.529004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d32a-1db9-4430-b993-3d450ce77492 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:09.529437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d32a-1db9-4430-b993-3d450ce77492 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:09.529598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d32a-1db9-4430-b993-3d450ce77492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:09.548148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cae6d32a-1db9-4430-b993-3d450ce77492 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:09.549377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cae6d32a-1db9-4430-b993-3d450ce77492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:09.558062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 07:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:09.707762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd938f0-f98a-429a-98d6-9374c3542465 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:09.723055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd938f0-f98a-429a-98d6-9374c3542465 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:09.728984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:09.729651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:09.729934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:09.730209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:09.738415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:09.739989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a489be-81c7-4f01-9051-ae038b7c6dd1 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:09.750931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 767/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:13.654509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:13.655110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:13.655110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:13.656498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:13.661749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635f46-c6d0-4a2f-9b89-d8a21e820e90 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:13.662182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635f46-c6d0-4a2f-9b89-d8a21e820e90 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:13.662358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35635f46-c6d0-4a2f-9b89-d8a21e820e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:13.683571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-35635f46-c6d0-4a2f-9b89-d8a21e820e90 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:13.684769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-35635f46-c6d0-4a2f-9b89-d8a21e820e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:13.692735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:13.764766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:13.766547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:13.795498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:13.823681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24aeccf-6d69-494e-a22b-17dabe9fdc02 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:13.827205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:13.827892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:13.828179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:13.828458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:13.838535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:13.839959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6fbdd0-1746-42ca-ba66-1f456a4359a0 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:13.849249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 762/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:15.867071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafa6e-93a7-43d3-aa4e-25eacd852a8f None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:15.867637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafa6e-93a7-43d3-aa4e-25eacd852a8f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:15.867637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aafa6e-93a7-43d3-aa4e-25eacd852a8f None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:15.869001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:15.874184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b5f4-4fa5-410d-b6a4-4e5c397bb5e1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:15.874628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b5f4-4fa5-410d-b6a4-4e5c397bb5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:15.874733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b5f4-4fa5-410d-b6a4-4e5c397bb5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:15.892831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7363b5f4-4fa5-410d-b6a4-4e5c397bb5e1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:15.894337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7363b5f4-4fa5-410d-b6a4-4e5c397bb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:15.902731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:15.937983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aafa6e-93a7-43d3-aa4e-25eacd852a8f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:15.948947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aafa6e-93a7-43d3-aa4e-25eacd852a8f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:15.952414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:15.953074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:15.953359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:15.953632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:15.963379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:15.964793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dba0c2-b9e7-48fd-bd09-05dc13550104 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:15.974250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 770/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:19.388133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:19.388659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:19.388659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:19.390005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:19.395286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22604-ee08-4729-ab0a-f4b18afbf8dd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:19.395692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22604-ee08-4729-ab0a-f4b18afbf8dd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:19.395844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc22604-ee08-4729-ab0a-f4b18afbf8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:19.415787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dbc22604-ee08-4729-ab0a-f4b18afbf8dd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:19.416974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dbc22604-ee08-4729-ab0a-f4b18afbf8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:19.424850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:19.729858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:19.731533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:19.786917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c4777d-1664-413f-93d4-4aafa2b1769d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:19.791146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:19.791787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:19.792070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:19.792342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:19.801015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:19.802455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcf129-1c87-4d70-ac58-4dbc570fd1f9 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:19.811662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 765/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:21.841601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:21.842176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:21.842176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:21.843526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 07:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:24:21.848561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa3df-ff1b-4e0b-9fc9-0ad48abe48e5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:21.848996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa3df-ff1b-4e0b-9fc9-0ad48abe48e5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:21.849146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa3df-ff1b-4e0b-9fc9-0ad48abe48e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:21.867206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6daaa3df-ff1b-4e0b-9fc9-0ad48abe48e5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:24:21.868438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6daaa3df-ff1b-4e0b-9fc9-0ad48abe48e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:21.876289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 07:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:24:22.178276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:24:22.180562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:24:22.193901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb65b44-7cc2-4e30-a216-ad9cb2b5d1da None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:24:22.198138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:24:22.198778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:24:22.199062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:24:22.199364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:24:22.208207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:24:22.209677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f666566-c44f-43c3-b49b-5fa8aefcb416 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:24:22.219769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 773/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:24:31.861975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=47 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:24:32.215490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=33 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:51.495428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.496105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.496105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.520779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:51.522562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:51.538173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 767/1540] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:51.546885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.547467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.547467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.579906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:51.581179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:51.594105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 774/1541] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:51.598650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:51.613189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfa766-5cd7-4891-b912-d9673b6cf32b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:51.618220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:51.618929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.619211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.619487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.620245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:51.620550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:51.622277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:51.640376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 768/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:51.648931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:51.661079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e4ba8f-ca5d-4c01-9a49-fcd20018b494 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:51.674545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:51.675243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.675710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.675995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.676716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:51.678845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0977a6e-d946-4a79-9aeb-c3146bdac41a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:51.779423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 775/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/projects => generated 377 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:51.783407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:51.797848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a52ca2-50cd-4065-a9be-aef9c7b8c873 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:51.800859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34a9c-5494-4626-9cd4-1e7774e18486 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.801190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34a9c-5494-4626-9cd4-1e7774e18486 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.801476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf34a9c-5494-4626-9cd4-1e7774e18486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.828712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cbf34a9c-5494-4626-9cd4-1e7774e18486 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:51.830149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cbf34a9c-5494-4626-9cd4-1e7774e18486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:51.910527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:51.911219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.911504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.911912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.912893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:51.914839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fcb34-114f-4564-bca7-58fdbfe1ce1a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:51.926364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 776/1544] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:51.928261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384f08-c391-4a13-b14a-a61032a3106d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.928731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384f08-c391-4a13-b14a-a61032a3106d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.929268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04384f08-c391-4a13-b14a-a61032a3106d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:51.965483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-04384f08-c391-4a13-b14a-a61032a3106d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:51.966707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-04384f08-c391-4a13-b14a-a61032a3106d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:51.980274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 777/1545] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:25:51.981671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:51.981968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:51.982246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.011315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.012526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.020445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 769/1546] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.023143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c29a83-b15d-4a64-aad4-01df51cd2c79 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.023143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c29a83-b15d-4a64-aad4-01df51cd2c79 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.023143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c29a83-b15d-4a64-aad4-01df51cd2c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.032812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 778/1547] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.033739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.053715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808735f-7eee-4185-ab5f-3f2853f77b11 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.063010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.063983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.064280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.064562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.065329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.066936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.069309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a3c29a83-b15d-4a64-aad4-01df51cd2c79 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.071049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a3c29a83-b15d-4a64-aad4-01df51cd2c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.092663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 770/1548] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.095794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962f8-cd1e-4335-8edc-fd0577d357b8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.096091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962f8-cd1e-4335-8edc-fd0577d357b8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.096371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0962f8-cd1e-4335-8edc-fd0577d357b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.097984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 779/1549] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:52.098776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.121048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d838b0-99ad-418e-aeb3-71cbfd2b81f5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.128683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.129389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.132615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.132903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.134069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.135461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.136517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:25:52.136517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:25:52.136517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:25:52.137561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4a0962f8-cd1e-4335-8edc-fd0577d357b8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.138937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4a0962f8-cd1e-4335-8edc-fd0577d357b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.140226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.156668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 771/1550] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.157692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 780/1551] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.158647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.165044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6835ce-e275-4654-af1e-5e892ba8e004 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.166344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6835ce-e275-4654-af1e-5e892ba8e004 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.167991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6835ce-e275-4654-af1e-5e892ba8e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.171103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5288113-78e2-4796-a5ae-0e46556b4b67 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.179585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.179585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.179585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.179585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.180232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.180232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.181131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.193484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 781/1552] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.194540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.196735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4a6835ce-e275-4654-af1e-5e892ba8e004 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.197975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4a6835ce-e275-4654-af1e-5e892ba8e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.204625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58892f56-cc6b-483d-92b7-c03696a2fd16 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.205967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 772/1553] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.207192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ca9-0aab-40d8-885a-ebd81f123180 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.207478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ca9-0aab-40d8-885a-ebd81f123180 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.207756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469ca9-0aab-40d8-885a-ebd81f123180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.210188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.211108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.211505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.211782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.212509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.214209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d5ea1-3ed2-4126-8f58-9533081e7f04 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.226110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 782/1554] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:52.227380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-04469ca9-0aab-40d8-885a-ebd81f123180 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.227525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6623c67-7f63-4634-9d30-e68f0b0df688 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.227698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6623c67-7f63-4634-9d30-e68f0b0df688 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.227975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6623c67-7f63-4634-9d30-e68f0b0df688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.228568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-04469ca9-0aab-40d8-885a-ebd81f123180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.238614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 773/1555] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.238614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.238614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.238614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.251989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c6623c67-7f63-4634-9d30-e68f0b0df688 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.253284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c6623c67-7f63-4634-9d30-e68f0b0df688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.257997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.263515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.263642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 783/1556] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.263642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.263642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.263642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.276740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 774/1557] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.276740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.282996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.283341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8bad1-f851-4382-9318-1c3d4e36f782 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.284161 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.288677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.289387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.289887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.290166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.290862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.291868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:25:52.291868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:25:52.291868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:25:52.293040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 784/1558] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.293173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9015993c-e586-4333-acda-932ee5fe7370 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.293801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.305263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057e210-e30f-47fc-989a-c1aeee6efae4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.310108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.310768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.311051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.311331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.312023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.313966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.393894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 775/1559] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.395316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871ab0-b51d-4c6f-8f8f-9b3536da7179 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.395613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871ab0-b51d-4c6f-8f8f-9b3536da7179 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.395893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98871ab0-b51d-4c6f-8f8f-9b3536da7179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.411082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 785/1560] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.411796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.414427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-98871ab0-b51d-4c6f-8f8f-9b3536da7179 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.415737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-98871ab0-b51d-4c6f-8f8f-9b3536da7179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.453132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:52.478801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54d2276-a5ad-4208-b1b4-fe35efe2d637 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.484848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 776/1561] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.484848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16240-124a-4599-837e-6a333dcba87e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.484848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16240-124a-4599-837e-6a333dcba87e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.484848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16240-124a-4599-837e-6a333dcba87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.487565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.488486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.488756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.489048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] PATH_INFO: `/v3/projects/ba23c9c3921243999a65174ae93ce26a/users/eaea1f637c35454bb2ac75c2eefc26d8/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.502740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e4f16240-124a-4599-837e-6a333dcba87e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.504060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e4f16240-124a-4599-837e-6a333dcba87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.504203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba23c9c3921243999a65174ae93ce26a, user_id=eaea1f637c35454bb2ac75c2eefc26d8, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.507430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dbfb24-35c2-4f6f-8a55-d401a429833e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.512638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 777/1562] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.514126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.514488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.514773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.549805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.551004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.558859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 778/1563] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.559635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.565494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:52.570707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 786/1564] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:52 2022] PUT /identity/v3/projects/ba23c9c3921243999a65174ae93ce26a/users/eaea1f637c35454bb2ac75c2eefc26d8/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:52.575779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021d77f-ee48-44f4-9cf2-bf37585fb5d9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.575916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.575916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.575916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.593359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.594711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.648358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.649192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.649477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.649755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.650501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.650812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.652438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.663247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 787/1565] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.664470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.669205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 779/1566] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.670074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.675360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ec85b-268e-4fa5-bfec-2b9edfe83b9f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.681209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.681894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.682177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.682452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.683153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.684251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:25:52.684251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:25:52.684251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:25:52.685668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.687664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48e05-1203-4c51-8bb7-ab8afffbb4cd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.692593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.693874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.694363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.694831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.695751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.697890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.780978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 788/1567] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.781605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.791964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b2bd0-952d-45c3-a758-668afe604e93 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.796593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.797327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.806211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.806211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.806211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.806716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 780/1568] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.806891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.807060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.807227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.812850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1a476-9d2e-4bd2-a95e-a161a152bec3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.817551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.818223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.818420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 789/1569] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.818591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.818776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.819183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.819688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.819902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.821608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7001758-2a06-4ff9-a92e-cbfef55bdf08 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.828850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d771-7d8a-4ab1-90cc-086312737616 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.833488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.834628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.834910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.835183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.836162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.836451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 781/1570] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.843434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.843574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.843673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.843771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.843771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.857654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 790/1571] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.857654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.857954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:52.858253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:52.861421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b960488-3a64-4b33-8e72-7e0daefa7618 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.866043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.866229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 782/1572] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:52.866804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.866928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.867119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.867364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.868091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:25:52.868399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.870028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.878254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bceb38e-f1b2-453f-a222-925e33d58019 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.882857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 791/1573] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:25:52.883623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.888839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.889870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.889994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.890266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.890986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.892926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.893207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cc40d-61e7-4342-94f6-535ecda68987 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.898907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.899570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.899860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.900145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.900886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.902625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.913521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 792/1574] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:52.914441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.923879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eaed4f-4381-4072-8005-100db87f0dec admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.928496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:52.929160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:52.929451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:52.929729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:52.930441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:52.932057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:52.941719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 793/1575] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:52.942460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.952346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8568977-7789-4be4-afe0-36c6361d3eb3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:52.957211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 783/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:52.957211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:52.994474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:53.012635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.013493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.013731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.014012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.014707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.016616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.027665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823623-6457-4a17-b960-e0f0c5e12af9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.032439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.033132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.034439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.034439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.034439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.036311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.078626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 794/1577] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.079393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.096159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 784/1578] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:52 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.097288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.123538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:53.146015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c17a8b-84d2-438b-90a1-77f432fbbbd0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.154461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fc4d91-9926-4bf8-b2bf-a37718af81c1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.160019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.160019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.160019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.160019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.201785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.202448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.202732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.203125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.203818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.205761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.220844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.222294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.232576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 785/1579] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:53.233374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.242910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef431d-57fd-4793-8336-6b5de76739b3 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.247413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.248161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.248484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.248770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.249492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.251342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.388448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 786/1580] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.389626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.407702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 795/1581] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/projects => generated 387 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.407702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.457461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a7ec-1981-4057-9eba-57a992f228d4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.469397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:53.473100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0fd4f-8fef-470e-b78a-c0c9a097fbcd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.479483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.480445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.480445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.480695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.481444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.483086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.494382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 796/1582] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:53.495208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.505002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822440e-2da4-431a-bfd4-9f0568b6ef72 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.513996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.513996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.513996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.513996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.514372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.516279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.524653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:53.537582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.537582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.537582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.537582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.538140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.539373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.549898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 787/1583] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:53.554482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.560953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fa9f5-b976-4202-a782-884fb0278047 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.565968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.570105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.570105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.570105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.570105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.570583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.593579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 797/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.594316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.603888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6594-f0a3-4404-990c-bf2798e5e00e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.608729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.612849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.612849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.612849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.612849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.612849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.689701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 788/1585] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.690574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.700529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c80fd1-ba3a-4a58-99ea-cd850f496711 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.705088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.706835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.707754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.708544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.709277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.711960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.714589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 798/1586] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.716386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.728536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6629872-06f3-49a3-bb33-70a37e908fc8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.733307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.734019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.734303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.734583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.735273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.737214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.793440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 789/1587] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.794380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.807016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e861d0-b7ff-4f66-87cf-72cc52b9e07f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.811688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.812570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.812858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.813173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] PATH_INFO: `/v3/projects/e271133dae67437a99fd675e61cc7bdc/users/63b7b0f3558f48e78d96a9002e019b9f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.828928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e271133dae67437a99fd675e61cc7bdc, user_id=63b7b0f3558f48e78d96a9002e019b9f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.830004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:25:53.830004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:25:53.830004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:25:53.832316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.843299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 799/1588] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:53 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:53.844448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.858006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73ddc4-272f-4998-aec8-66d5ad22c63a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.864049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.865149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.866032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.866223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] PATH_INFO: `/v3/projects/930a5af9847947e3b7bff17634b8a63a/users/316409696eea4dceb554847900adcabf/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.884248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930a5af9847947e3b7bff17634b8a63a, user_id=316409696eea4dceb554847900adcabf, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.887077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.891643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 790/1589] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:53 2022] PUT /identity/v3/projects/e271133dae67437a99fd675e61cc7bdc/users/63b7b0f3558f48e78d96a9002e019b9f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:53.891643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.968305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01f400-3b94-45c7-b69f-606279933c7e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:53.973130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:53.973964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:53.975665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:53.979378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:53.981732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:53.982540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 800/1590] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:53 2022] PUT /identity/v3/projects/930a5af9847947e3b7bff17634b8a63a/users/316409696eea4dceb554847900adcabf/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:53.983163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:53.983631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:53.995638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 791/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:53.996746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.007749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c7c24-f998-4a64-a214-a692c8e1bd16 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.063618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def2e92-fcc4-4246-8512-4b89a9806932 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.069281 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.070097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.070422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.070705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.071109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.071467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.071937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.072296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.072645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.073086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.073550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.075200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.085837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 801/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.090495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 792/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.090495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.090726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.100013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ce1e6-d3f2-45ea-b3cb-d792938038a4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.101413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de19a1-62a4-4343-8c0e-4ae8aea3acd6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.104507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.105196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.106073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.106073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.106247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.106522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.106730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.107021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.107304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.108067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.108171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ffd78b-4e94-4afd-80c7-522b398035d1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.109686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55cdb0-821c-4455-9caf-8b22740570b5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.118238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 802/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.119463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.119767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.120088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.122382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 793/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.122557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.124953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.124953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.148553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] MFA Rules not processed for user `63b7b0f3558f48e78d96a9002e019b9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.157909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.158058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] MFA Rules not processed for user `316409696eea4dceb554847900adcabf`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.158058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.158058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:54.201518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:54.225470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 803/1596] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.225470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.232118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 794/1597] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.233164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.246656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e60c9e-9bbf-4350-a5c2-1739e2b27778 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.250751 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9bd1db-7009-4293-a418-b280235306ff None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.253734 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.255481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.256738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.257590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.258433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.260456 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.263037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.264082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.264376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.264653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.265444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.269096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.280232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 795/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.281063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.291290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 804/1599] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.292106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111eab5-41c2-4ef7-bb61-ef83c5d721eb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.292242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.299091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.300209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.300565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.300930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.302284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.304124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.305770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f659d-1af6-41af-884f-7e3b1ee25d65 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.310794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.311459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.312021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.312021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.312767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.314396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0e2c-5365-4d5e-a14e-eaeed3678f1c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.314834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 796/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.315777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.338877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 805/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.338877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdcfc7-09af-4689-afa9-ee97b87db138 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.338877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdcfc7-09af-4689-afa9-ee97b87db138 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.339353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5fb84-f28a-4670-90ea-ce26d1f9c530 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdcfc7-09af-4689-afa9-ee97b87db138 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 806/1602] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 12 07:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f980-0bfa-4d1e-b2aa-8f280f601bf5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f980-0bfa-4d1e-b2aa-8f280f601bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33f980-0bfa-4d1e-b2aa-8f280f601bf5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.339458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 807/1603] 10.222.0.27 () {54 vars in 961 bytes} [Tue Jul 12 07:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:25:54.340224 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.340336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33f980-0bfa-4d1e-b2aa-8f280f601bf5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.340433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.340433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.340433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.340433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.342010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.351006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33f980-0bfa-4d1e-b2aa-8f280f601bf5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.355016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 797/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:54.355690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.355937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.356876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.357208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.357485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] PATH_INFO: `/v3/projects/6e21268b20834313a5a48010dd832059/users/71b891b8ddd648a29944dd04172a01d7/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.368334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78af96-86be-4e88-a4ef-2325ca7cdee6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.373215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.374116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.374448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e21268b20834313a5a48010dd832059, user_id=71b891b8ddd648a29944dd04172a01d7, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.374553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.374861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] PATH_INFO: `/v3/projects/1388398a0d65436ab322eea57c5a829e/users/cdb7fe3950e54a72ae60c122b1cece8c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.377171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad15f1-8ccf-432a-9bbf-a7e6dd18d1c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.390107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1388398a0d65436ab322eea57c5a829e, user_id=cdb7fe3950e54a72ae60c122b1cece8c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.392764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.455014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 798/1605] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:54 2022] PUT /identity/v3/projects/1388398a0d65436ab322eea57c5a829e/users/cdb7fe3950e54a72ae60c122b1cece8c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:54.455310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 808/1606] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:54 2022] PUT /identity/v3/projects/6e21268b20834313a5a48010dd832059/users/71b891b8ddd648a29944dd04172a01d7/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:54.455969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.456754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.457076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.457342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.496260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.497613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.535211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ce50d-bf0c-49b6-9ad5-5b775cdd1021 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.584787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 809/1607] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.587968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.600202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:54.607677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.608698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.608988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.609308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] PATH_INFO: `/v3/projects/0782a7821e2e4370a7dd672129197b02/users/0d26426cd8cf47c5949a10f586ea14f7/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.625358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0782a7821e2e4370a7dd672129197b02, user_id=0d26426cd8cf47c5949a10f586ea14f7, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.628075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd413a0-fa4b-4ae6-8cf8-b40f42d7afea admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.673063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0aa9d1-6c8e-4494-ba2f-f81df9d796c3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.678980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.679904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.680186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.680461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] PATH_INFO: `/v3/projects/89c6ddc1065f4536a94c0701760177ac/users/aa3fccaf85b74ebb98f5701b7014bd05/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.695448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6ddc1065f4536a94c0701760177ac, user_id=aa3fccaf85b74ebb98f5701b7014bd05, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.698206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.732971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 799/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:54 2022] PUT /identity/v3/projects/0782a7821e2e4370a7dd672129197b02/users/0d26426cd8cf47c5949a10f586ea14f7/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:54.732971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08317cd9-1ca1-456d-a280-effaf0ddf6e2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.732971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08317cd9-1ca1-456d-a280-effaf0ddf6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.732971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08317cd9-1ca1-456d-a280-effaf0ddf6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.755097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-08317cd9-1ca1-456d-a280-effaf0ddf6e2 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.756627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-08317cd9-1ca1-456d-a280-effaf0ddf6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.805506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 810/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:54 2022] PUT /identity/v3/projects/89c6ddc1065f4536a94c0701760177ac/users/aa3fccaf85b74ebb98f5701b7014bd05/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:54.806473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:54.824707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:54.850112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 800/1610] 10.222.0.27 () {58 vars in 1058 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.851600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57799-fa25-45cc-9632-ea2d12de2d14 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.851889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57799-fa25-45cc-9632-ea2d12de2d14 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.852165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d57799-fa25-45cc-9632-ea2d12de2d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.870797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-22d57799-fa25-45cc-9632-ea2d12de2d14 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.872372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-22d57799-fa25-45cc-9632-ea2d12de2d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.882727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d05184-fdae-4413-a236-2a47a3d3cf4e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:54.887459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:54.888353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.888634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.888909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] PATH_INFO: `/v3/projects/fcfb19bc4a754f46b026416f24964eb9/users/858da270173c4944ab3c7829bd698c4a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.916393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcfb19bc4a754f46b026416f24964eb9, user_id=858da270173c4944ab3c7829bd698c4a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:54.919119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a38275-27ff-4568-9a35-ebd6fc154fb4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:54.949065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 801/1611] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.949065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:54.949065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:54.949065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:54.976035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:54.977245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:54.985325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 802/1612] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:54.986147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.002412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 811/1613] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:54 2022] PUT /identity/v3/projects/fcfb19bc4a754f46b026416f24964eb9/users/858da270173c4944ab3c7829bd698c4a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:55.002412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802632-6ed9-4395-8511-1bcb91e02b79 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.002412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802632-6ed9-4395-8511-1bcb91e02b79 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.002412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08802632-6ed9-4395-8511-1bcb91e02b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.037693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-08802632-6ed9-4395-8511-1bcb91e02b79 None None] MFA Rules not processed for user `0d26426cd8cf47c5949a10f586ea14f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:55.038922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-08802632-6ed9-4395-8511-1bcb91e02b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:55.076115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:55.082778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d855e1-2697-4c6b-a32b-6f7cd1f531fb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.118689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 812/1614] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:55.120021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.120311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.120590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.159224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] MFA Rules not processed for user `aa3fccaf85b74ebb98f5701b7014bd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:55.160495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:55.170093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.171169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.171738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.172211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.239544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 813/1615] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:55.240980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.244322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.246027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.254227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c7968-ee0a-4fc0-8000-dcc348ea8f5e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.258111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 803/1616] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:55.261520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.261520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:55.261833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.262341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.262447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.262687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.268585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:55.324204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27577129-64b4-44cb-888c-77d30b09d866 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.326115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.328552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.329321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.329807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.330094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.330369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.342087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 814/1617] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:55.343228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.353394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6377fb-999a-4965-9ca0-ff7d750de85d service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.357503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.358870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.358870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.359062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.450384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:55.475351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.478238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.479213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.480922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7c8d6-6e47-4566-a683-a0b705144669 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.492972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 804/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:55.496128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.496666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.497355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.500753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 815/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:55.502212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.513460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024247f8-f9e3-4b47-bae6-a9d32dedd731 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.519762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:55.520122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.521104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.521729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:55.521851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.522227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.523085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.525438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529442f-aa85-4f07-8910-4594546faed7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.538658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 805/1620] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:55.538658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.549668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc0deb-a8ae-4cb8-8f76-ae05371e6fc4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.565014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.595064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.595064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.595064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.595064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.595064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:55.800996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 806/1621] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:55 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:55.800996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.808235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 816/1622] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:25:55 2022] POST /identity/v3/projects => generated 371 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:55.816325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d48de-b7b4-474f-8889-c40715ab1329 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.816325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d48de-b7b4-474f-8889-c40715ab1329 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.816325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d48de-b7b4-474f-8889-c40715ab1329 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.837262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 817/1623] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 12 07:25:55 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:25:55.837262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d48de-b7b4-474f-8889-c40715ab1329 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:55.931610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b386ce-6f42-4a23-8865-b9fff22f9b6f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.961187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d48de-b7b4-474f-8889-c40715ab1329 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:55.967571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:55.968309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:55.968539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:55.968822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:55.969588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:55.971543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.034732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.040207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.040207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.040207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.040481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 818/1624] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:55 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:56.040481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.048920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.051171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78f84b-ce9b-447d-8bb4-0794b53492a8 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.058453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d485bca-5973-4a69-bb10-6d5988ce05fc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.062995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 807/1625] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:56.064907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.065323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.065542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.065923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.066604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.067028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.067425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.069263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.071633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d2c2d0-b0f3-4fb5-897a-e7f4172982a6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.084075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:56.091691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:56.093181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:56.155588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 819/1626] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:25:56 2022] POST /identity/v3/users => generated 292 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:25:56.157465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a60c-a268-431d-b5ec-9ddc0cd50ce5 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.157644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a60c-a268-431d-b5ec-9ddc0cd50ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.160982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a60c-a268-431d-b5ec-9ddc0cd50ce5 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.165500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 820/1627] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 12 07:25:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:25:56.167790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305a60c-a268-431d-b5ec-9ddc0cd50ce5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.178900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 808/1628] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:25:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:56.179973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.182639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305a60c-a268-431d-b5ec-9ddc0cd50ce5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.188193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.189099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.189449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.189789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.190596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.191454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653dc71-0712-4078-af7c-9a0caf52e7e4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.192333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b651cc08-dc31-4811-85ad-8d31e4b12284 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.197871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.198805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.199176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.199505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.200823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.202004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.206487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 821/1629] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:56.207211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.207505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.207788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.211874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:56.217419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 809/1630] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:56.218362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.227169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:56.228415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:56.238089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 822/1631] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:25:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:56.238785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.250566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89b2e3-19d7-4356-92fd-f03f6d6a561f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.258186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.258186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.258186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.258186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] PATH_INFO: `/v3/projects/7fd98c03cef746fbaf2cefff3987196f/users/4dc09c24ec404983ac68c69a70195e13/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.273790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd98c03cef746fbaf2cefff3987196f, user_id=4dc09c24ec404983ac68c69a70195e13, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.276914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.301378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30544e-174b-4e23-b0db-74671bb96b87 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.306226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.306950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.307774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.308068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.323955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.326588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.348545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 810/1632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:56.350450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.363840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b4aeb-a017-486e-b701-c80a42079d47 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.370932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.372014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.372310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.372636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] PATH_INFO: `/v3/projects/e382cfaf68604b01b69a139ce9174967/users/fd1894cc5fad4eef8b3997a4cff5cd0e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.380423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 823/1633] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:56 2022] PUT /identity/v3/projects/7fd98c03cef746fbaf2cefff3987196f/users/4dc09c24ec404983ac68c69a70195e13/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:56.382689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.405152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e382cfaf68604b01b69a139ce9174967, user_id=fd1894cc5fad4eef8b3997a4cff5cd0e, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.405321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.475036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 811/1634] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:56 2022] PUT /identity/v3/projects/e382cfaf68604b01b69a139ce9174967/users/fd1894cc5fad4eef8b3997a4cff5cd0e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:56.478141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.543963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd8396-78d7-4d23-b964-e5e4ae55e5ae admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.622630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c465-1ba4-4758-9816-0182814101ef admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.633869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.634650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.635051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.635392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.637990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.638696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.638984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.639261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.640246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.641999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.665354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 812/1635] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:56.669390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.693606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ba632-0f9d-49a7-97be-ab4df05d81da admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.718498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.719187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.719471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.719749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.720483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.726487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.751019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 813/1636] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:25:56.752002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.770366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090870c-a85c-426b-ab3b-1e697557a604 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.773549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.780084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be5183-cf42-4259-870d-ddb2b3de0fc3 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.780743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.781927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.782416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.782893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] PATH_INFO: `/v3/projects/7fd98c03cef746fbaf2cefff3987196f/users/4dc09c24ec404983ac68c69a70195e13/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.787744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd98c03cef746fbaf2cefff3987196f, user_id=4dc09c24ec404983ac68c69a70195e13, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.792058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:56.830983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 814/1637] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:56 2022] PUT /identity/v3/projects/7fd98c03cef746fbaf2cefff3987196f/users/4dc09c24ec404983ac68c69a70195e13/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:56.830983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:56.836813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 824/1638] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:56.839650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.840162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.841079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.858012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:56.909599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] MFA Rules not processed for user `4dc09c24ec404983ac68c69a70195e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:56.915093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:56.917056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:56.937416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8a122-e8cd-4850-8cda-5ae88c0ed137 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:56.953920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:56.955146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:56.955633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:56.956186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] PATH_INFO: `/v3/projects/e382cfaf68604b01b69a139ce9174967/users/fd1894cc5fad4eef8b3997a4cff5cd0e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:56.981870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e382cfaf68604b01b69a139ce9174967, user_id=fd1894cc5fad4eef8b3997a4cff5cd0e, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:56.981870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc202f3d-e3ec-46d7-adeb-fd58b20ceb4e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:57.008441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 815/1639] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:25:56 2022] PUT /identity/v3/projects/e382cfaf68604b01b69a139ce9174967/users/fd1894cc5fad4eef8b3997a4cff5cd0e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:57.019500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:57.019804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:57.020073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:57.092385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] MFA Rules not processed for user `fd1894cc5fad4eef8b3997a4cff5cd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:57.093683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:57.104833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 825/1640] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:57.538184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:57.538184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1218-48d9-4624-a88d-2f4cfd8d951c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:57.544394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 816/1641] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:57.544394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:57.548267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:57.548267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:57.548267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:57.548267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:57.549190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b39bd6-6b93-4ab7-aa81-655ed66d19ac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:57.549190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:57.549190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:57.549190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] PATH_INFO: `/v3/users/316409696eea4dceb554847900adcabf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316409696eea4dceb554847900adcabf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: WARNING py.warnings [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: warnings.warn(msg) Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: Jul 12 07:25:57.556446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:57.589753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:57.591390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:57.595775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:57.615923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 826/1642] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:57.636639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:57.649235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7249-8e35-46e0-8d12-3f67d2024b05 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:57.657355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:57.658432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:57.658779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:57.659126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] PATH_INFO: `/v3/users/aa3fccaf85b74ebb98f5701b7014bd05` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:57.661002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa3fccaf85b74ebb98f5701b7014bd05)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:57.676874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:57.763578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316409696eea4dceb554847900adcabf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.905694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316409696eea4dceb554847900adcabf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.906373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316409696eea4dceb554847900adcabf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.945186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316409696eea4dceb554847900adcabf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.946874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa3fccaf85b74ebb98f5701b7014bd05'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.947361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:25:57.972803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316409696eea4dceb554847900adcabf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:57.981875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 817/1643] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:25:57 2022] DELETE /identity/v3/users/316409696eea4dceb554847900adcabf => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:25:57.982502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:57.991875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.043612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa3fccaf85b74ebb98f5701b7014bd05'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:58.063021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa3fccaf85b74ebb98f5701b7014bd05'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:58.069498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa3fccaf85b74ebb98f5701b7014bd05'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:58.091168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c8525886-31cd-43aa-b90a-d74846a0cece admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa3fccaf85b74ebb98f5701b7014bd05'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:25:58.095377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caed516-741a-4102-b8c9-ee4350f30d11 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:58.102922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 827/1644] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:25:57 2022] DELETE /identity/v3/users/aa3fccaf85b74ebb98f5701b7014bd05 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:25:58.104120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:58.104421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:58.104702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:58.105341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:58.106231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:58.106702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:58.107179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:58.109534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.172057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:58.173339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.265656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:58.271803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6046f-97e7-4f9d-8dd4-d49f1dfaef76 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:58.300173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 818/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:25:58.305526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:58.306390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 828/1646] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:58.306779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:58.307123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:58.346946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:25:58.348755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.357297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:58.358556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.370262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 819/1647] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:25:58.427550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:58.429094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:58.483038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22400370-11f5-407f-9476-52c2e7028ea0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:58.494929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:58.495606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:58.495889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:58.496165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:58.521395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:58.523132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:58.541661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 829/1648] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:25:58.554349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5245f-688d-4a68-bebd-cb21f933601c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:58.562991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:58.563728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:58.564257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:58.564619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:58.607219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:58.613158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338cefb1-a77d-4f62-8347-13d897123146 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:58.659454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 820/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:25:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:25:59.861101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:25:59.865105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:25:59.889131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8f7bf-7d96-4bcd-967b-1139b075d903 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:25:59.913766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:25:59.916635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:25:59.922309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:25:59.922745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] PATH_INFO: `/v3/users/0d26426cd8cf47c5949a10f586ea14f7` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:25:59.926656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d26426cd8cf47c5949a10f586ea14f7)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:25:59.936157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:25:59.954352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:00.195452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d26426cd8cf47c5949a10f586ea14f7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:00.254888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d26426cd8cf47c5949a10f586ea14f7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:00.279845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d26426cd8cf47c5949a10f586ea14f7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:00.282135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d26426cd8cf47c5949a10f586ea14f7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:00.300197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d26426cd8cf47c5949a10f586ea14f7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:00.329110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 830/1650] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:25:59 2022] DELETE /identity/v3/users/0d26426cd8cf47c5949a10f586ea14f7 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:00.333848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:00.335922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:00.335922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:00.373238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:00.381923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:00.469193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:00.519420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 821/1651] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:00.668127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:00.669637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:00.811264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7707c856-0482-4151-8b53-fcfc3d7b1f9e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:00.816549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:00.817711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:00.818549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:00.819023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:00.836858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:00.847542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:00.869506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 831/1652] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:00.935030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:00.940621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:00.972659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550f038-8c2f-4cd4-aff0-352d2f1d98c1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:00.991440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:00.996645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:00.996953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:00.997267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] PATH_INFO: `/v3/projects/89c6ddc1065f4536a94c0701760177ac` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:01.014926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c6ddc1065f4536a94c0701760177ac)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:01.018455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:01.234015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c6ddc1065f4536a94c0701760177ac', 'request_id': 'req-a84a8472-f6b4-4537-b684-7691bfb0ae32'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.329654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c6ddc1065f4536a94c0701760177ac', 'request_id': 'req-a84a8472-f6b4-4537-b684-7691bfb0ae32'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.340841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c6ddc1065f4536a94c0701760177ac', 'request_id': 'req-a84a8472-f6b4-4537-b684-7691bfb0ae32'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.371601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] The token cache is being invalidate because project 89c6ddc1065f4536a94c0701760177ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:01.372180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.374021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.376507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 822/1653] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:00 2022] DELETE /identity/v3/projects/89c6ddc1065f4536a94c0701760177ac => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:01.380357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:01.392123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f359cf9-f564-4c8b-ba9c-036e1af78cd9 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:01.493582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:01.494770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:01.495407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:01.495891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] PATH_INFO: `/v3/users/4dc09c24ec404983ac68c69a70195e13` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:01.497463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dc09c24ec404983ac68c69a70195e13)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:01.500605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:01.565543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:01.567268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:01.594985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a8472-f6b4-4537-b684-7691bfb0ae32 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:01.601123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:01.604780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:01.605435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:01.605868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] PATH_INFO: `/v3/projects/930a5af9847947e3b7bff17634b8a63a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:01.607656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930a5af9847947e3b7bff17634b8a63a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:01.610592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:01.708208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:01.737100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dc09c24ec404983ac68c69a70195e13'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.809805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930a5af9847947e3b7bff17634b8a63a', 'request_id': 'req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.873014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dc09c24ec404983ac68c69a70195e13'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.895186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dc09c24ec404983ac68c69a70195e13'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.896326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dc09c24ec404983ac68c69a70195e13'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.915122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-42e622f2-6855-4d22-b14a-90a787959fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dc09c24ec404983ac68c69a70195e13'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.928128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 832/1654] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:01 2022] DELETE /identity/v3/users/4dc09c24ec404983ac68c69a70195e13 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:01.969286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930a5af9847947e3b7bff17634b8a63a', 'request_id': 'req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:01.981796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930a5af9847947e3b7bff17634b8a63a', 'request_id': 'req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:02.039587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] The token cache is being invalidate because project 930a5af9847947e3b7bff17634b8a63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:02.039587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:02.040411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9c27bd1-ae60-48bf-a914-e0fbb05a3322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:02.045509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 823/1655] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:01 2022] DELETE /identity/v3/projects/930a5af9847947e3b7bff17634b8a63a => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:02.052117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.053699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.054697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.101411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:02.102664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:02.216355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 833/1656] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:02.224658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148173e-668b-4679-9556-e05cbf794821 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.225273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148173e-668b-4679-9556-e05cbf794821 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.225713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148173e-668b-4679-9556-e05cbf794821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.278188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f148173e-668b-4679-9556-e05cbf794821 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:02.279759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f148173e-668b-4679-9556-e05cbf794821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:02.302982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 824/1657] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:02.307596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:02.322932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab8cef-885c-419b-b6dd-91fd6213b437 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:02.346924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:02.350104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.353533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.353533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.353533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:02.353533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:02.353817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:02.389409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 834/1658] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:02.400647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148173e-668b-4679-9556-e05cbf794821 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:02.416744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148173e-668b-4679-9556-e05cbf794821 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:02.434519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:02.435714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.436247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.436843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.437850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:02.453146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:02.593487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 825/1659] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:02 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:02.595045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:02.619593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3067e-96bb-4f6d-98ad-2b0342f577ce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:02.803618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:02.803618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.803960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.804313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.805165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:02.808011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:02.918367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 835/1660] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:02 2022] POST /identity/v3/users => generated 281 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:02.922661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:02.947013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c1272-d325-421c-8674-f5ab1ee1c8d5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:02.968710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:02.969946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:02.970578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:02.971061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:02.975487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:02.978397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:02.995727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 826/1661] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:02.996747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.017677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f44208-7ded-41f0-be60-945711e4c329 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:03.034820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:03.035537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.044125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.046991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.049531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:03.055433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:03.086533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 836/1662] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:03.091033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.096659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:03.103683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01291cf5-33ad-44d8-b86f-6756e62eec38 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:03.109451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:03.118157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.118503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.118798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] PATH_INFO: `/v3/projects/ddd47f86a1c54a388dea028d58c891fb/users/cddcd8d7216c423ea2b5f17c97208de5/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.128367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.134726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:03.164774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd47f86a1c54a388dea028d58c891fb, user_id=cddcd8d7216c423ea2b5f17c97208de5, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:03.168178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef84f3-d0c7-4adc-89d6-92e76dd1b89c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:03.171882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7061ae-e7ed-47ca-90bc-3aade8789980 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:03.178874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:03.181000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.181778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.182702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] PATH_INFO: `/v3/projects/0782a7821e2e4370a7dd672129197b02` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.185015 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0782a7821e2e4370a7dd672129197b02)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:03.186316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: WARNING py.warnings [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 07:26:03.186316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: warnings.warn(msg) Jul 12 07:26:03.186316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: Jul 12 07:26:03.188794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:03.201293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:03.273909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 827/1663] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:03 2022] PUT /identity/v3/projects/ddd47f86a1c54a388dea028d58c891fb/users/cddcd8d7216c423ea2b5f17c97208de5/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:03.284622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.284937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.285256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.357539 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0782a7821e2e4370a7dd672129197b02', 'request_id': 'req-aec2aa2c-62f2-4317-8886-b6c4b421b885'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.358481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] MFA Rules not processed for user `cddcd8d7216c423ea2b5f17c97208de5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:03.361465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:03.432217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0782a7821e2e4370a7dd672129197b02', 'request_id': 'req-aec2aa2c-62f2-4317-8886-b6c4b421b885'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.460034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0782a7821e2e4370a7dd672129197b02', 'request_id': 'req-aec2aa2c-62f2-4317-8886-b6c4b421b885'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.488055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] The token cache is being invalidate because project 0782a7821e2e4370a7dd672129197b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:03.488345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.494207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.496588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 837/1664] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:03 2022] DELETE /identity/v3/projects/0782a7821e2e4370a7dd672129197b02 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:03.497611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.499214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:03.505249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 828/1665] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:03.506410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.611733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991400c-65c4-475d-8aaa-b170efc2c203 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:03.617663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:03.618795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.619241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.619812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] PATH_INFO: `/v3/users/fd1894cc5fad4eef8b3997a4cff5cd0e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.634223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1894cc5fad4eef8b3997a4cff5cd0e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:03.639483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:03.704106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2aa2c-62f2-4317-8886-b6c4b421b885 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:03.718427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:03.719019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:03.719305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:03.719585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:03.720432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:03.726212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:03.858938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 838/1666] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:03.875830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:03.893185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1894cc5fad4eef8b3997a4cff5cd0e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.957700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1894cc5fad4eef8b3997a4cff5cd0e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.958390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1894cc5fad4eef8b3997a4cff5cd0e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:03.983825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1894cc5fad4eef8b3997a4cff5cd0e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.013975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1894cc5fad4eef8b3997a4cff5cd0e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.014554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca96920-fad0-453b-9fd0-01d6560354e1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.022749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.025039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.025039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.025039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.025775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.028346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.033977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 829/1667] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:03 2022] DELETE /identity/v3/users/fd1894cc5fad4eef8b3997a4cff5cd0e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:04.095991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:04.138552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 839/1668] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:03 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:04.142905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.144428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:04.301587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b4c337-58cc-4d98-9f23-221d42dd03ca admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.312886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.315366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.315658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.315945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.324690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.330739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.369006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 830/1669] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:04.372242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.403503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65934932-3d82-415b-a02d-589b08dc4b39 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.417366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.419149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.419806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.420410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] PATH_INFO: `/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b/users/b4e0ca0305df42f993719fbe20ebfc89/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.439188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:04.466676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cad9c2474944e2b8bbdc9af7352e17b, user_id=b4e0ca0305df42f993719fbe20ebfc89, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.469734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.500185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.502163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:04.526459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f134e-ce77-4771-aac3-5f9afd86c479 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.539793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.540690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.540976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.541281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] PATH_INFO: `/v3/projects/7fd98c03cef746fbaf2cefff3987196f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.546622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd98c03cef746fbaf2cefff3987196f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.548825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 840/1670] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:04 2022] PUT /identity/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b/users/b4e0ca0305df42f993719fbe20ebfc89/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:04.549915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.553077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.683118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd98c03cef746fbaf2cefff3987196f', 'request_id': 'req-f0e7a3f7-54d6-42a4-be75-00fab955760b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.685778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ea24-efed-40bc-bdcd-c93c7de1bfbf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.757944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd98c03cef746fbaf2cefff3987196f', 'request_id': 'req-f0e7a3f7-54d6-42a4-be75-00fab955760b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.764459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd98c03cef746fbaf2cefff3987196f', 'request_id': 'req-f0e7a3f7-54d6-42a4-be75-00fab955760b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.792295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] The token cache is being invalidate because project 7fd98c03cef746fbaf2cefff3987196f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:04.792882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.793800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f0e7a3f7-54d6-42a4-be75-00fab955760b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:04.795728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 831/1671] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:04 2022] DELETE /identity/v3/projects/7fd98c03cef746fbaf2cefff3987196f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:04.800739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c3cf-a27b-44ae-80df-8c0e574cf948 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.801176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c3cf-a27b-44ae-80df-8c0e574cf948 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.801510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542c3cf-a27b-44ae-80df-8c0e574cf948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.810990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.812553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.813983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.814491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.815821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.817786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.838412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6542c3cf-a27b-44ae-80df-8c0e574cf948 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:04.839354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 841/1672] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:26:04.841708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6542c3cf-a27b-44ae-80df-8c0e574cf948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:04.843865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.845900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:04.864577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 832/1673] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:04.867684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f5ff6-0e2a-4652-9d02-d8c9e31a837c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:04.873190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.873489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.873772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.889505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:04.892943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.893600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.894395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] PATH_INFO: `/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b/users/b4e0ca0305df42f993719fbe20ebfc89/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:04.900998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cad9c2474944e2b8bbdc9af7352e17b, user_id=b4e0ca0305df42f993719fbe20ebfc89, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:04.912560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1ee7e-1fc5-469d-af0b-054d509ee954 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:04.914210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:04.919280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:04.968351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 833/1674] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:04.972166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 842/1675] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:04 2022] PUT /identity/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b/users/b4e0ca0305df42f993719fbe20ebfc89/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:04.973220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:04.984077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:04.984849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:04.985330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.036543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2f88a-f232-4fb3-83ba-7992ad415e37 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.071503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] MFA Rules not processed for user `b4e0ca0305df42f993719fbe20ebfc89`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:05.075611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:05.180745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:05.201784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.202491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.202780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.203059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.203809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:05.204125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.205787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.246058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 834/1676] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:05.253818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.280805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bdd71-b37d-4aca-be47-af28b09a48cc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.292288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.292972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.293382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.293556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.294257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.296166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd721c-1071-4ab8-818f-6f1da0b4762e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.300963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 843/1677] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:05.317381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.322405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:05.349873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:05.404817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 835/1678] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:05 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:05.407130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.407420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.407791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.467911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] MFA Rules not processed for user `eaea1f637c35454bb2ac75c2eefc26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:05.469177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:05.495412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694dde4b-3c34-452e-85b8-9355746770a8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.599791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 836/1679] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:05.608079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.627538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.628290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.628632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.638919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.738071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.741682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.745503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24ddd6-5440-4dcf-8eed-ac4613a41cf6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.757418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.760414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 844/1680] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:05.761495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.761862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.762662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.765725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.766798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.771914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:05.775844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.892078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 837/1681] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:05 2022] POST /identity/v3/users => generated 290 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:05.894788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.898225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:05.914302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0546a89-61fd-4b23-b451-eb43a82c9dd6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.919609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.920499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.920785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.921082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] PATH_INFO: `/v3/users/63b7b0f3558f48e78d96a9002e019b9f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.922348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b7b0f3558f48e78d96a9002e019b9f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.924604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.939387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b1df4-1514-48db-ae93-163bba53f441 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:05.955887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:05.960063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:05.960063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:05.960063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:05.963917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:05.977240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:05.979006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:05.990082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 845/1682] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:05.991035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:05.992517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.023673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac4345-af9c-46ae-b874-4a252b828171 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.038027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.039163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.039386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.039667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] PATH_INFO: `/v3/projects/e382cfaf68604b01b69a139ce9174967` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.041037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e382cfaf68604b01b69a139ce9174967)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.044986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.146961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:06.163702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b7b0f3558f48e78d96a9002e019b9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.191729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e382cfaf68604b01b69a139ce9174967', 'request_id': 'req-c764a64d-b819-4055-99ec-029baa7c0180'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.215793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b7b0f3558f48e78d96a9002e019b9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.216852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b7b0f3558f48e78d96a9002e019b9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.237898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b7b0f3558f48e78d96a9002e019b9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.251762 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b7b0f3558f48e78d96a9002e019b9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.267889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 838/1683] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:05 2022] DELETE /identity/v3/users/63b7b0f3558f48e78d96a9002e019b9f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:06.267889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.267889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.278517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e382cfaf68604b01b69a139ce9174967', 'request_id': 'req-c764a64d-b819-4055-99ec-029baa7c0180'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.299429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e382cfaf68604b01b69a139ce9174967', 'request_id': 'req-c764a64d-b819-4055-99ec-029baa7c0180'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.322799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] The token cache is being invalidate because project e382cfaf68604b01b69a139ce9174967 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:06.323093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.323779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:06.325505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 846/1684] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:05 2022] DELETE /identity/v3/projects/e382cfaf68604b01b69a139ce9174967 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:06.329843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.329843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.412296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764a64d-b819-4055-99ec-029baa7c0180 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.420717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3782103-57d7-4d90-96ba-9d7f6bf7ad4a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.431633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.434195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.434514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.434901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.435662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.445044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85b57c-61d9-4355-a63d-aa16ecd7d7cf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.474726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 839/1685] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:06.480476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1121-ac8a-4f55-bd55-809e6af72304 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.480816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1121-ac8a-4f55-bd55-809e6af72304 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.481276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d1121-ac8a-4f55-bd55-809e6af72304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.481463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.482124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.482406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.482735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.484647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.526142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-997d1121-ac8a-4f55-bd55-809e6af72304 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:06.530345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-997d1121-ac8a-4f55-bd55-809e6af72304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.548318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:06.553522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 840/1686] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:06.553522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db27d-1b7c-4dce-9ab0-e5d1b21cc6ab None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.553522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db27d-1b7c-4dce-9ab0-e5d1b21cc6ab None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.553522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89db27d-1b7c-4dce-9ab0-e5d1b21cc6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.565177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.568728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.581970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 847/1687] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:06.582764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.584936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.603623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5f544-f64c-4e16-b616-0fbb10fd6fcd service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.608936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.609735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.610435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.610784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.611676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.613448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.613970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e89db27d-1b7c-4dce-9ab0-e5d1b21cc6ab None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:06.621338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e89db27d-1b7c-4dce-9ab0-e5d1b21cc6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.627498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 848/1688] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:06.631558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.643897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28b02-1e13-4071-bb59-7ec598e2f7e2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.652706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 841/1689] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:06.652964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.654122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.654597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.655181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] PATH_INFO: `/v3/projects/265a1ddf59c845268321ccfbf75d2bf9/users/be23f51d8b994b32851a88f92ede45e4/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.660558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.666898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.666898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.679748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=265a1ddf59c845268321ccfbf75d2bf9, user_id=be23f51d8b994b32851a88f92ede45e4, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.685282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.733770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:06.742868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.759444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 842/1690] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:06.760471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.761298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 849/1691] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:06 2022] PUT /identity/v3/projects/265a1ddf59c845268321ccfbf75d2bf9/users/be23f51d8b994b32851a88f92ede45e4/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:06.763253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:06.777087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:06.864345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29220e-06c2-4f52-981c-f58e2dc6b76e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.942269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:06.947668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ee977-b24d-49c0-a9e5-3846a820f471 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:06.960316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.963002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.964137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.964878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.969808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:06.970520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:06.970814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:06.971098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:06.971844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:06.972158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.982072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:06.982949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:06.985474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f1487-1923-4c34-814e-440bb816db9c service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.000670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 843/1692] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:07.002655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.003300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.003773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.019953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 850/1693] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:07.025403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.055899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae131fcb-a1e1-411c-a50f-f15bea9c997e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.061938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] MFA Rules not processed for user `be23f51d8b994b32851a88f92ede45e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:07.062179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.062746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:07.063253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.063711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.064161 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.065085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.079255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.206235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 851/1694] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:07.207257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.279131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 844/1695] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:07.282591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.302229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63ac7-cd77-427e-938f-91fa39213000 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.374121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05447e8c-8367-4d9d-90b8-72f254b561d8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.387400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.388108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.388396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.388677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.389422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.397451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.423704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.424390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.424680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.425092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.425838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.427910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.492644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 852/1696] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/users => generated 290 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:07.493929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.520838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda3960-eca9-4b5c-8d33-ff2b41ee077f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.563585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 845/1697] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/projects => generated 379 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:07.564297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.565626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.567082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.567381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.568899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.571107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.575647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.602454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 853/1698] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:07.610392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.638046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:07.646271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005484d6-f0c1-487e-b930-d872d0ae15f1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.741152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.741861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.742148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.742672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.743159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.747226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.754030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ce669-1a91-4e9d-b48f-04261951bcc5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.759194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.759891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.760183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.762930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.762930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.763162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.773777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 854/1699] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:07.776002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:07.777797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.800558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283e163-7c40-4310-9526-121a2943fb74 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.807215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:07.808619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.809078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.809622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] PATH_INFO: `/v3/projects/2fc97f4f4f2c4ad2930682c6bb7833e3/users/0d991b3114034a3a9fe710ffe104ec67/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:07.831214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc97f4f4f2c4ad2930682c6bb7833e3, user_id=0d991b3114034a3a9fe710ffe104ec67, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:07.836416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d161ed9-9cea-412e-b551-cc4107a3baa8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:07.897870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 846/1700] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/users => generated 296 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:07.906533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:07.928680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 855/1701] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:07 2022] PUT /identity/v3/projects/2fc97f4f4f2c4ad2930682c6bb7833e3/users/0d991b3114034a3a9fe710ffe104ec67/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:07.938096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84e13a-1e89-4253-a456-0b8903fdfd23 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:07.945688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:07.946048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:07.946335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.052580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] MFA Rules not processed for user `0d991b3114034a3a9fe710ffe104ec67`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:08.055378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:08.163078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.163794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.166097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.166399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.169490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.175368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.206363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 847/1702] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:08.209751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.242060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d51e5ab-373c-4f08-a0b0-28ec36035fde admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.257275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.260955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.261287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.262253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] PATH_INFO: `/v3/projects/3ef86e66f5df44bf89770a6229cb9b17/users/3c5f0f04656f4894b65865614aa7e73a/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.268864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 856/1703] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:08.270268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.332919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6653e50f-f565-42e1-a4e5-a740c2bac170 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.359350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef86e66f5df44bf89770a6229cb9b17, user_id=3c5f0f04656f4894b65865614aa7e73a, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.367110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.369399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.369692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.369977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.370706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.376365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.396710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.512517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 848/1704] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:08 2022] PUT /identity/v3/projects/3ef86e66f5df44bf89770a6229cb9b17/users/3c5f0f04656f4894b65865614aa7e73a/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:08.517654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 857/1705] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:08 2022] POST /identity/v3/projects => generated 377 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:08.517809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.519819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.681005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:08.719749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d596aa3-33e8-4aac-a5e2-58d041da8da2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.743005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.753042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3f8c-2ad1-4a95-b7f1-d1b81940bf9c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.755427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.756033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.756798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.757335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.759036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.801561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.802559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.805341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.805739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.806587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.810860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.834868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 849/1706] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:08.838248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.845791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:08.883563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8a405-1697-424c-a632-c960e6bf4d3c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.893914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.894915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.895325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.896400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] PATH_INFO: `/v3/projects/e271133dae67437a99fd675e61cc7bdc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.899743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e271133dae67437a99fd675e61cc7bdc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:08.901819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:08.953487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 858/1707] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:08 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:08.953487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:08.976363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb0da-761b-4bc1-9d33-a5aa78e9e2ff admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:08.987490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:08.989341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:08.991054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:08.992601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] PATH_INFO: `/v3/projects/3ef86e66f5df44bf89770a6229cb9b17/users/3c5f0f04656f4894b65865614aa7e73a/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:08.996826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef86e66f5df44bf89770a6229cb9b17, user_id=3c5f0f04656f4894b65865614aa7e73a, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:09.007974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:09.049325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 859/1708] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:08 2022] PUT /identity/v3/projects/3ef86e66f5df44bf89770a6229cb9b17/users/3c5f0f04656f4894b65865614aa7e73a/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:09.050606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:09.113804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e271133dae67437a99fd675e61cc7bdc', 'request_id': 'req-6c1d89b0-e808-4729-a254-b98e6613df73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:09.198019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e271133dae67437a99fd675e61cc7bdc', 'request_id': 'req-6c1d89b0-e808-4729-a254-b98e6613df73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:09.201551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:09.206639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e271133dae67437a99fd675e61cc7bdc', 'request_id': 'req-6c1d89b0-e808-4729-a254-b98e6613df73'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:09.247831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] The token cache is being invalidate because project e271133dae67437a99fd675e61cc7bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:09.248240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:09.261583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6c1d89b0-e808-4729-a254-b98e6613df73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:09.272350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 850/1709] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:08 2022] DELETE /identity/v3/projects/e271133dae67437a99fd675e61cc7bdc => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:09.274101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.281474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.281945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.285074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c149d3f-522e-430d-88c2-74f65a7b7c41 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:09.373221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] MFA Rules not processed for user `3c5f0f04656f4894b65865614aa7e73a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:09.376246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.523866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:09.526082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.528886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.529394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.531366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:09.534890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0db15-2bd5-40e2-868e-72a7af4e8695 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:09.550652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 860/1710] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:09.553305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.554145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.554564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.592552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 851/1711] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:09.595451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:09.595941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:09.600187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.605841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.651418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 861/1712] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:09.651927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:09.656423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.669751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921d831-b0a1-481b-b9a7-8028c58ddb87 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:09.681575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:09.683341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.684475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.684767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.686959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:09.691005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128417dd-4d44-45b8-affe-ad5d45f6e3fa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:09.726506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 852/1713] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:09.727275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.727565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.727843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.803382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:09.807781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.833898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 853/1714] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:09.835990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:09.852186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fa657-ba2f-4b27-8b52-173587711f11 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:09.862683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:09.862870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7ef3b-e154-4cc9-be6f-c6a55ea909eb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:09.863561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.863763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.864032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.866757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:09.879642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:09.881468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:09.881811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:09.882086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] PATH_INFO: `/v3/projects/750fe7a9b2f244c78d88f71d2a68b706/users/ec033816e2754e98bdedb9ca2735d327/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:09.892913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:09.942422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750fe7a9b2f244c78d88f71d2a68b706, user_id=ec033816e2754e98bdedb9ca2735d327, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:09.949985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d61980-4b99-494f-a182-9e88c9fc33e9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.017514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.019033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.055321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 862/1715] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:10.068116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:10.104272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 854/1716] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:09 2022] PUT /identity/v3/projects/750fe7a9b2f244c78d88f71d2a68b706/users/ec033816e2754e98bdedb9ca2735d327/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:10.115554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.116469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.119450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.119657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d68ec-71bd-4dcb-aab3-546d2b1b0d46 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:10.188929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] MFA Rules not processed for user `ec033816e2754e98bdedb9ca2735d327`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:10.192463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:10.326999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:10.326999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.346830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.351553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.352633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:10.353929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.357791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.395971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 863/1717] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:10.399076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:10.420737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f9211-f434-4cb0-91c0-2ee21b3c2140 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:10.440442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 855/1718] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:10.440645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:10.440645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.440645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.440645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.440977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.440977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba959c5-c040-4eef-935c-09ab8d50fde6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.442601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:10.460095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b3f7d8-d4b1-40cf-b6f5-b1632296e284 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:10.472398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:10.473185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.473400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.478793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.478793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.482655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.581864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 864/1719] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/projects => generated 405 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:10.584257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.586260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.586732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.602201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:10.617231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 856/1720] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:10.618131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:10.699137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] MFA Rules not processed for user `858da270173c4944ab3c7829bd698c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:10.702399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:10.858246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5d052-1c02-470e-8fd1-7b0d4c4aa99a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:10.885064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:10.885788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.886082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.886361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.887071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.889080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:10.918375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 865/1721] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:10.920380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:10.951729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410b658d-2f4c-4ad6-bedf-bb09c4ae4880 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:10.976562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:10.979362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:10.979875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:10.980701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:10.989181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:10.993160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.011910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 857/1722] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/users => generated 303 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:11.014097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.017067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:11.020143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:11.098048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 866/1723] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:10 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:11.099832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.129689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80106d60-b6c9-4f36-a9df-65696762cd2f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.147985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.149488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.149868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.150456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.151332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.155253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.180404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 867/1724] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:11.185250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.233797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367af47-8ce5-4fc5-bd02-922565860b8e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.252782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.257296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.257586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.257868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.258991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc270b-b04d-4aec-bc46-8e3cd4ff5d09 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.261216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.265522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.285709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.286859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.288210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.288678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.298361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 868/1725] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:11.300982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.311724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.313728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.329442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970f4ea-7822-4ca2-a6e7-ab001e6bddce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.339738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 858/1726] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:11.340931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.341851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.342588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.342876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.343153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.343887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.346542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.366547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 869/1727] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:11.367658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.372238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d10b1-59fe-472b-bf90-fabf27b6b293 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.383557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.384446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235e67a-4cbe-400b-864b-db3ec90d577f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.384554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.384772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.385076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] PATH_INFO: `/v3/projects/0352994c838940cf8dc6cbb8faa60908/users/1cce53305f654c5fa6058c4b02f18c41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.390022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.391315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.391814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.393348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] PATH_INFO: `/v3/projects/d34941d9f85c4b64960cd51e948fad14/users/f1cf833664324c70b4266b5b45a196da/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.417413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d34941d9f85c4b64960cd51e948fad14, user_id=f1cf833664324c70b4266b5b45a196da, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.420821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13677e1c-5e29-4493-a68e-c67161b04cc4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.422092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0352994c838940cf8dc6cbb8faa60908, user_id=1cce53305f654c5fa6058c4b02f18c41, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.424846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.478734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 870/1728] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:11 2022] PUT /identity/v3/projects/d34941d9f85c4b64960cd51e948fad14/users/f1cf833664324c70b4266b5b45a196da/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:11.480285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d200-0cb1-4dce-9314-3da83d348c43 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.480623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d200-0cb1-4dce-9314-3da83d348c43 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.480900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95d200-0cb1-4dce-9314-3da83d348c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.499181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 859/1729] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:11 2022] PUT /identity/v3/projects/0352994c838940cf8dc6cbb8faa60908/users/1cce53305f654c5fa6058c4b02f18c41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:11.503229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.527470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ef95d200-0cb1-4dce-9314-3da83d348c43 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:11.528695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ef95d200-0cb1-4dce-9314-3da83d348c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:11.628492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:11.676650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da9f0d-9581-41dc-aefe-6fc2d0da3361 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.690462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.697441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.697724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.698007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.702533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 871/1730] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:11.706201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.708158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870246-98f3-491f-88f6-1efa3d02c8ca None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.709159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870246-98f3-491f-88f6-1efa3d02c8ca None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.709447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870246-98f3-491f-88f6-1efa3d02c8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.712683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.752894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 860/1731] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:11.754902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.788348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e4f40-9152-4946-861e-dee495f81bbd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.800039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0e870246-98f3-491f-88f6-1efa3d02c8ca None None] MFA Rules not processed for user `cdb7fe3950e54a72ae60c122b1cece8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:11.802624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0e870246-98f3-491f-88f6-1efa3d02c8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:11.807627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.808913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.809442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.810396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] PATH_INFO: `/v3/projects/0352994c838940cf8dc6cbb8faa60908/users/1cce53305f654c5fa6058c4b02f18c41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.816083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0352994c838940cf8dc6cbb8faa60908, user_id=1cce53305f654c5fa6058c4b02f18c41, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:11.820613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:11.861986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 861/1732] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:11 2022] PUT /identity/v3/projects/0352994c838940cf8dc6cbb8faa60908/users/1cce53305f654c5fa6058c4b02f18c41/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:11.861986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:11.864987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:11.943923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 872/1733] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:11.945561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:11.945847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:11.946119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:11.987189 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8548319-d58c-4b5c-a524-eff64695f890 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:11.995938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:11.999536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:12.000001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:12.000441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:12.021677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] MFA Rules not processed for user `1cce53305f654c5fa6058c4b02f18c41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:12.023371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:12.053248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:12.124077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:12.125205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac80be-cab4-4a2b-9004-65423dfdf2b0 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:12.141010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 862/1734] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:12.149584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:12.150138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:12.150564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:12.189884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 873/1735] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:12.205700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:12.222014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] MFA Rules not processed for user `cdb7fe3950e54a72ae60c122b1cece8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:12.226557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:12.362162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557fe878-116b-4476-8f3a-f288f23a8e51 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:12.388226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:12.388921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:12.390869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:12.391170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:12.398234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 863/1736] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:12.414691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:12.419463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:12.422836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:12.425596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:12.463758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 874/1737] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:12.559179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:12.671418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0713d8-e758-489d-9c8b-55163e7e8c5e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:12.688529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:12.689387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:12.689863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:12.690213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:12.718311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:12.722857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:12.767016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 864/1738] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:12.850818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:12.860087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda90ff-5901-4c53-af5f-1ffaf39339d3 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:12.910862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:12.911711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:12.929293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:12.929628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:12.946770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:13.129298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:13.130932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8673ac4d-1b32-4f56-86ae-0594c83793a7 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:13.164137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 875/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:13.232387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:13.248005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cc42d-94c0-43d1-b455-f7a3f7f24560 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:13.261382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:13.262076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:13.263501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:13.263819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:13.390065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:13.392655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655d9e0-f94f-4247-9b7c-97fa08fc33cd service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:13.406786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6623ca-c422-4d16-916a-78cd787f5edf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:13.407348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6623ca-c422-4d16-916a-78cd787f5edf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:13.407348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6623ca-c422-4d16-916a-78cd787f5edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:13.423843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 865/1740] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:13.435160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-db6623ca-c422-4d16-916a-78cd787f5edf None None] MFA Rules not processed for user `eaea1f637c35454bb2ac75c2eefc26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:13.436390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-db6623ca-c422-4d16-916a-78cd787f5edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:13.537758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:13.556200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 876/1741] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:13.665552 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:13.667010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:13.668936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:13.782570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] MFA Rules not processed for user `71b891b8ddd648a29944dd04172a01d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:13.783900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:13.878521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37150-a82f-4ffe-a4e2-557002312bdf None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:13.878814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37150-a82f-4ffe-a4e2-557002312bdf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:13.879095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c37150-a82f-4ffe-a4e2-557002312bdf None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:13.881067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 877/1742] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 12 07:26:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:13.907456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffb77b-cf03-491e-9973-7bd22780a95d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:13.907456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffb77b-cf03-491e-9973-7bd22780a95d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:13.907456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffb77b-cf03-491e-9973-7bd22780a95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:13.996853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 866/1743] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:14.007919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-10ffb77b-cf03-491e-9973-7bd22780a95d None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:14.010994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10ffb77b-cf03-491e-9973-7bd22780a95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:14.045653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 878/1744] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:26:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:14.127816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:14.148646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e4109-aa1c-487b-8109-d84971338bcb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:14.165955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:14.166694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:14.167016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:14.167268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:14.191649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:14.208736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c3e7dd-1b7c-4039-b96c-f0bee43456cd service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:14.235729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 867/1745] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:14.724249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:14.724851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:14.724851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:14.726633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 879/1746] 10.222.0.27 () {54 vars in 912 bytes} [Tue Jul 12 07:26:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:14.736589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:14.737334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:14.737781 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:14.813632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:14.814984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:14.830609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 868/1747] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:26:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:14.840421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:14.844088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:14.887131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd3b54-75c6-4ea8-9660-b531fee3a730 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:14.915488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:14.919057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:14.924851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:14.925998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:14.960989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:14.964406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b717633-5630-45b2-a609-eca28b6e54da service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:14.989985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 880/1748] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:15.274982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:15.302505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f556e-11e4-4d13-9f79-6f238a53b1ac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:15.333942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:15.335375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:15.336648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:15.337232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:15.361818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:15.364359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49788a2e-ba4d-470a-9330-63f57f78141a service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:15.392711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 869/1749] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:15.433888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a860-957b-4baf-bcd2-6fe6641e938d None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:15.434179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a860-957b-4baf-bcd2-6fe6641e938d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:15.434460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29a860-957b-4baf-bcd2-6fe6641e938d None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:15.439613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 881/1750] 10.222.0.27 () {54 vars in 960 bytes} [Tue Jul 12 07:26:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:15.444055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705909-9c43-485d-9f58-a689e680d8a3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:15.444402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705909-9c43-485d-9f58-a689e680d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:15.444691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4705909-9c43-485d-9f58-a689e680d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:15.459835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:15.508065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f4705909-9c43-485d-9f58-a689e680d8a3 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:15.516721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f4705909-9c43-485d-9f58-a689e680d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:15.752624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 870/1751] 10.222.0.27 () {58 vars in 1057 bytes} [Tue Jul 12 07:26:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:15.761061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a860-957b-4baf-bcd2-6fe6641e938d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:15.783230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29a860-957b-4baf-bcd2-6fe6641e938d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:15.809087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:15.809783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:15.810068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:15.811616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:15.815001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:15.856553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:15.858048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:15.887613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 882/1752] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:16.764816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:16.768540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:16.768870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:16.806252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] MFA Rules not processed for user `f1cf833664324c70b4266b5b45a196da`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:16.808073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:17.023156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 871/1753] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:17.028101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:17.045677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dac4f-948e-4fe5-8d2d-bc730687758b service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:17.062545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:17.062867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:17.063159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:17.063437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:17.071760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:17.077366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:17.286070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 883/1754] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:17 2022] POST /identity/v3/projects => generated 405 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:17.290565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:17.307942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570b265-df18-4a1c-9aec-ae03423cd842 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:17.434334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:17.435058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:17.435351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:17.435646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:17.438242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:17.441190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:17.590879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 872/1755] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:17 2022] POST /identity/v3/users => generated 309 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:17.592185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:17.606596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a7cf-6d57-43ea-8bca-f7c5cbaf4128 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:17.631458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:17.632307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:17.632696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:17.633119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:17.634325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:17.636111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:17.716493 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:17.716696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 884/1756] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:17.733979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb397-385b-47b4-92de-c8d144dff738 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:17.744355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:17.745878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:17.746148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:17.746424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] PATH_INFO: `/v3/projects/078e164c04f546aaaef828d391215c8f/users/634c4c7bba1d4218851fcba4c49c9019/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:17.774605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e164c04f546aaaef828d391215c8f, user_id=634c4c7bba1d4218851fcba4c49c9019, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:17.780012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cfe7c8-aca6-4d52-b3f3-dba562ec7624 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:17.787682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:17.858292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 873/1757] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:17 2022] PUT /identity/v3/projects/078e164c04f546aaaef828d391215c8f/users/634c4c7bba1d4218851fcba4c49c9019/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:17.864311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:17.881597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebb56c-f9f1-45a8-8ca8-5b6aeae39bc5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:17.926437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:17.927048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:17.928863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:17.966035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] MFA Rules not processed for user `858da270173c4944ab3c7829bd698c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:17.968072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:18.048673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:18.049772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:18.050415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:18.050767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:18.051572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:18.054236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:18.067708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 885/1758] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:26:18.073651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 874/1759] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:18.075275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:18.089013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad48730-ccc0-4b6b-8e64-f501f9526b52 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:18.095247 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:18.096559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:18.098027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:18.098512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] PATH_INFO: `/v3/projects/078e164c04f546aaaef828d391215c8f/users/634c4c7bba1d4218851fcba4c49c9019/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:18.103191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078e164c04f546aaaef828d391215c8f, user_id=634c4c7bba1d4218851fcba4c49c9019, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:18.106787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1700a289-9c15-46dc-ad78-90ce13c8a5c4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:18.133431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 886/1760] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:18 2022] PUT /identity/v3/projects/078e164c04f546aaaef828d391215c8f/users/634c4c7bba1d4218851fcba4c49c9019/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:18.359452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:18.361104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:18.388219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae1a97-b2ee-4acd-9b3c-869b1fed560f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:18.610226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:18.612183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:18.612183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:18.612340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] PATH_INFO: `/v3/users/be23f51d8b994b32851a88f92ede45e4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:18.613703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be23f51d8b994b32851a88f92ede45e4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:18.615658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:18.863687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be23f51d8b994b32851a88f92ede45e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:18.942389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be23f51d8b994b32851a88f92ede45e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:18.943905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be23f51d8b994b32851a88f92ede45e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:18.963436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be23f51d8b994b32851a88f92ede45e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:18.973059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be23f51d8b994b32851a88f92ede45e4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:18.985331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 875/1761] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:18 2022] DELETE /identity/v3/users/be23f51d8b994b32851a88f92ede45e4 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:18.990287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:18.990731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:18.991022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:19.025460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:19.026947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.175951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:19.182204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.185426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 887/1762] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:19.188147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:19.191409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.196598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:19.208692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acad151-4a30-4846-8764-b0afe44e9eb9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:19.226933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:19.227870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:19.228160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:19.229205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] PATH_INFO: `/v3/users/0d991b3114034a3a9fe710ffe104ec67` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:19.232309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d991b3114034a3a9fe710ffe104ec67)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:19.238027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:19.267395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:19.287450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c461ac1-6cb4-45eb-80f1-a20af276575a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:19.292198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:19.293337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:19.293932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:19.294359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:19.311218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:19.312671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:19.323446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 888/1763] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:19.466206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:19.467845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.489191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a164f82-b7a4-4d84-a128-7670047074b1 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:19.508555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:19.513011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:19.515125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:19.516836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] PATH_INFO: `/v3/users/cddcd8d7216c423ea2b5f17c97208de5` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:19.518672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d991b3114034a3a9fe710ffe104ec67'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.520439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cddcd8d7216c423ea2b5f17c97208de5)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:19.557475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:19.649708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d991b3114034a3a9fe710ffe104ec67'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.650284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d991b3114034a3a9fe710ffe104ec67'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.687621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d991b3114034a3a9fe710ffe104ec67'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.696457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6b0a601b-13dd-4cd8-a5da-42c855e346e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d991b3114034a3a9fe710ffe104ec67'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.708867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 876/1764] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:19 2022] DELETE /identity/v3/users/0d991b3114034a3a9fe710ffe104ec67 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:19.710550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:19.711175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:19.711567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:19.732046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:19.734937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.867793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 877/1765] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:19.909525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cddcd8d7216c423ea2b5f17c97208de5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:19.929626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:19.931436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:19.987214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cddcd8d7216c423ea2b5f17c97208de5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:20.019390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cddcd8d7216c423ea2b5f17c97208de5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:20.024351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cddcd8d7216c423ea2b5f17c97208de5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:20.044144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bf28f-f3fe-46c8-b8ae-5a37e9ffb10d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:20.049171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:20.050942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.052281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.052945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.055561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.058803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c4eeaabc-c00f-434d-b1e3-6a2e0f20b493 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cddcd8d7216c423ea2b5f17c97208de5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:20.079574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:20.081652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 889/1766] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:19 2022] DELETE /identity/v3/users/cddcd8d7216c423ea2b5f17c97208de5 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:20.084649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db76cc94-d6f1-4523-a16f-06da1f097989 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:20.101653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.101653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.101653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.117429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 878/1767] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:20.165963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:20.170652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.321356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aa0a-30ce-4c2c-8b81-0c7f7de2b558 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.321733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aa0a-30ce-4c2c-8b81-0c7f7de2b558 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.322023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668aa0a-30ce-4c2c-8b81-0c7f7de2b558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.328283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 890/1768] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:20.339470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:20.341079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.375873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2668aa0a-30ce-4c2c-8b81-0c7f7de2b558 None None] MFA Rules not processed for user `71b891b8ddd648a29944dd04172a01d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:20.383597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2668aa0a-30ce-4c2c-8b81-0c7f7de2b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.417493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:20.473492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:20.509053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c2d5b3-efec-4ca8-8cd5-4d0b0e91f9e3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:20.518100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:20.520631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.522642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.523139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.537975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 879/1769] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:20.543865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:20.545859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:20.561859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 891/1770] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:20.765411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17adfb-5ef1-4750-a66b-a458aae8a09d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.765744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17adfb-5ef1-4750-a66b-a458aae8a09d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.766097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17adfb-5ef1-4750-a66b-a458aae8a09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.805114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:20.806566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.837540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae833ef-be35-40a3-ad91-44df1089ebde service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:20.841773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4d17adfb-5ef1-4750-a66b-a458aae8a09d None None] MFA Rules not processed for user `634c4c7bba1d4218851fcba4c49c9019`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:20.843528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4d17adfb-5ef1-4750-a66b-a458aae8a09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:20.849346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:20.850239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:20.850523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:20.851048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] PATH_INFO: `/v3/projects/265a1ddf59c845268321ccfbf75d2bf9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:20.866814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=265a1ddf59c845268321ccfbf75d2bf9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:20.873877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:21.045238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 880/1771] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:20 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:21.102965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '265a1ddf59c845268321ccfbf75d2bf9', 'request_id': 'req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.220771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '265a1ddf59c845268321ccfbf75d2bf9', 'request_id': 'req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.234758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '265a1ddf59c845268321ccfbf75d2bf9', 'request_id': 'req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.263441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:21.263802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:21.264305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:21.300966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] The token cache is being invalidate because project 265a1ddf59c845268321ccfbf75d2bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:21.301288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.304657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.306771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 892/1772] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:20 2022] DELETE /identity/v3/projects/265a1ddf59c845268321ccfbf75d2bf9 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:21.310989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:21.312427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:21.392206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:21.394546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:21.469066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6204dc-fa78-473f-ae0d-cb51066c4fb7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:21.491465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:21.493589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:21.494080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:21.494782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] PATH_INFO: `/v3/users/3c5f0f04656f4894b65865614aa7e73a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:21.497147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c5f0f04656f4894b65865614aa7e73a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:21.501374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:21.554431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 881/1773] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:26:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:21.816466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:21.828158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c5f0f04656f4894b65865614aa7e73a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.906898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c5f0f04656f4894b65865614aa7e73a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.961771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c5f0f04656f4894b65865614aa7e73a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:21.967344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c5f0f04656f4894b65865614aa7e73a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:22.014382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c5f0f04656f4894b65865614aa7e73a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:22.048057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 893/1774] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:21 2022] DELETE /identity/v3/users/3c5f0f04656f4894b65865614aa7e73a => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:22.139499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:22.140995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:22.332906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:22.483595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87e9e2-0371-4ebf-87ff-3c9fe43f1dc4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:22.674195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:22.676689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:22.678541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:22.678953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:22.681581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:22.838870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:22.841063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:22.861208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 882/1775] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:26:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:26:23.054652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:23.057198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:23.243650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9fef-4340-4d8a-9375-af2d13830860 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:23.255115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:23.256162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:23.259542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:23.259542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] PATH_INFO: `/v3/projects/2fc97f4f4f2c4ad2930682c6bb7833e3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:23.259542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc97f4f4f2c4ad2930682c6bb7833e3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:23.264344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:23.505798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc97f4f4f2c4ad2930682c6bb7833e3', 'request_id': 'req-13ede008-d46f-400e-8d7b-706d926fb773'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:23.580857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc97f4f4f2c4ad2930682c6bb7833e3', 'request_id': 'req-13ede008-d46f-400e-8d7b-706d926fb773'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:23.596747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc97f4f4f2c4ad2930682c6bb7833e3', 'request_id': 'req-13ede008-d46f-400e-8d7b-706d926fb773'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:23.629585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] The token cache is being invalidate because project 2fc97f4f4f2c4ad2930682c6bb7833e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:23.630198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:23.631717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:23.634460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 894/1776] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:23 2022] DELETE /identity/v3/projects/2fc97f4f4f2c4ad2930682c6bb7833e3 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:23.646901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:23.673789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12b38b-6d01-4350-8ab2-3a38b129e022 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:24.043051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:24.045254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:24.045613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:24.045900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] PATH_INFO: `/v3/users/ec033816e2754e98bdedb9ca2735d327` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:24.056061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec033816e2754e98bdedb9ca2735d327)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:24.069147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:24.076011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:24.416957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec033816e2754e98bdedb9ca2735d327'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:24.776472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec033816e2754e98bdedb9ca2735d327'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:24.776472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec033816e2754e98bdedb9ca2735d327'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:24.776472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec033816e2754e98bdedb9ca2735d327'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:24.776472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7785c1bd-a294-4425-8b8c-15ac57f2e591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec033816e2754e98bdedb9ca2735d327'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:24.776472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 883/1777] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:23 2022] DELETE /identity/v3/users/ec033816e2754e98bdedb9ca2735d327 => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:25.234563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:25.236857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:25.261594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:25.261874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:25.262157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:25.264270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ede008-d46f-400e-8d7b-706d926fb773 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:25.314730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:25.320795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:25.344536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:25.358978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:25.359993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:25.360374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:25.360747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] PATH_INFO: `/v3/projects/3ef86e66f5df44bf89770a6229cb9b17` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:25.362165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef86e66f5df44bf89770a6229cb9b17)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:25.368196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:25.497924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 884/1778] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Jul 12 07:26:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:25.554903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:25.559156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:25.611274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec10b4-8f9e-42c0-a781-cdee548a1cbf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:25.636620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef86e66f5df44bf89770a6229cb9b17', 'request_id': 'req-544eef6b-8ba4-4a87-9620-6cf41568dfa9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:25.718035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef86e66f5df44bf89770a6229cb9b17', 'request_id': 'req-544eef6b-8ba4-4a87-9620-6cf41568dfa9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:25.730324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef86e66f5df44bf89770a6229cb9b17', 'request_id': 'req-544eef6b-8ba4-4a87-9620-6cf41568dfa9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:25.767741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] The token cache is being invalidate because project 3ef86e66f5df44bf89770a6229cb9b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:25.769258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:25.770180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-544eef6b-8ba4-4a87-9620-6cf41568dfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:25.776121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 895/1779] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:25 2022] DELETE /identity/v3/projects/3ef86e66f5df44bf89770a6229cb9b17 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:25.781786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6018-dd9d-4c94-8afa-0b307db393bd None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:25.781969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6018-dd9d-4c94-8afa-0b307db393bd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:25.783254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d6018-dd9d-4c94-8afa-0b307db393bd None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:25.786233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 896/1780] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:26:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:25.791327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:25.792611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:25.794535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:25.813992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:25.816246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:25.817394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:25.817394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] PATH_INFO: `/v3/projects/ddd47f86a1c54a388dea028d58c891fb` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:25.821925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd47f86a1c54a388dea028d58c891fb)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:25.831301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:25.885278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:25.889053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:25.917081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 897/1781] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:25.919042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:25.922210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.073249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:26.097541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd47f86a1c54a388dea028d58c891fb', 'request_id': 'req-d75f524d-f692-48f4-b7df-fdae429d72b7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:26.169837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd47f86a1c54a388dea028d58c891fb', 'request_id': 'req-d75f524d-f692-48f4-b7df-fdae429d72b7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:26.174363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32403-c8f1-4f61-9402-5f2086b3f4e9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:26.179509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd47f86a1c54a388dea028d58c891fb', 'request_id': 'req-d75f524d-f692-48f4-b7df-fdae429d72b7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:26.209093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] The token cache is being invalidate because project ddd47f86a1c54a388dea028d58c891fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:26.209396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:26.212755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d75f524d-f692-48f4-b7df-fdae429d72b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:26.224855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 885/1782] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:25 2022] DELETE /identity/v3/projects/ddd47f86a1c54a388dea028d58c891fb => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:26.229681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.229681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.229681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.285082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:26.290674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.303272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:26.305268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.311595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.311595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.316224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.353923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:26.358859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174a6cf-9274-44b4-b3f4-8eaf5d736be3 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:26.385336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 898/1783] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:26.389282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.390595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.391704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.415594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 886/1784] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:26:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:26.418035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:26.422583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.429974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:26.431205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.554840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:26.621921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 899/1785] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:26.621921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:26.635960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6510e-4ff9-408b-b32a-6a8f161dc095 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:26.638760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.642610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:26.648137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.648427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.648710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] PATH_INFO: `/v3/users/b4e0ca0305df42f993719fbe20ebfc89` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.650151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e0ca0305df42f993719fbe20ebfc89)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:26.652097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:26.699893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886a99b-a214-4e77-90f9-43394aa78a28 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:26.710580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:26.716873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.716873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.716873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.726573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:26.730856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:26.752325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 900/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:26.753251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:26.781175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c73e9-5649-4757-aa91-b3675bcf1086 service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:26.790354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:26.791044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.791329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.791614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.792346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:26.792673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:26.794291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:26.812078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 901/1787] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:26.812795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:26.814705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:26.852071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15041e76-80c9-42d0-a6ca-f3e16ef6d640 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:26.860289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:26.860289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:26.860289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:26.860289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] PATH_INFO: `/v3/projects/750fe7a9b2f244c78d88f71d2a68b706` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:26.881768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750fe7a9b2f244c78d88f71d2a68b706)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:26.884277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:26.971835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e0ca0305df42f993719fbe20ebfc89'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.049722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e0ca0305df42f993719fbe20ebfc89'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.050674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e0ca0305df42f993719fbe20ebfc89'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.055583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:27.092911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e0ca0305df42f993719fbe20ebfc89'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.120667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750fe7a9b2f244c78d88f71d2a68b706', 'request_id': 'req-64cabfa7-0b73-4479-a70b-a45eec7e1e54'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.128435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e0ca0305df42f993719fbe20ebfc89'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.143542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 887/1788] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:26 2022] DELETE /identity/v3/users/b4e0ca0305df42f993719fbe20ebfc89 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:27.147347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:27.148352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:27.180847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750fe7a9b2f244c78d88f71d2a68b706', 'request_id': 'req-64cabfa7-0b73-4479-a70b-a45eec7e1e54'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.192040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750fe7a9b2f244c78d88f71d2a68b706', 'request_id': 'req-64cabfa7-0b73-4479-a70b-a45eec7e1e54'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.220089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] The token cache is being invalidate because project 750fe7a9b2f244c78d88f71d2a68b706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:27.220533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.223923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.230843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 902/1789] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:26 2022] DELETE /identity/v3/projects/750fe7a9b2f244c78d88f71d2a68b706 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:27.232022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:27.235390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:27.293376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db53e9-fc2d-429d-9732-2ca701968d6b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:27.305101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:27.305101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:27.305101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:27.305101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:27.305708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:27.320752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:27.408364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cabfa7-0b73-4479-a70b-a45eec7e1e54 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:27.408364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:27.409367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:27.409748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:27.410127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] PATH_INFO: `/v3/users/1cce53305f654c5fa6058c4b02f18c41` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:27.412483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cce53305f654c5fa6058c4b02f18c41)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:27.414705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:27.470525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 888/1790] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:27 2022] POST /identity/v3/projects => generated 387 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:27.480369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:27.482405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:27.661780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30dc2f-9fde-491d-9096-d236cd074221 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:27.679126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:27.679863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:27.680113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:27.680385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:27.681148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:27.682834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:27.684493 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:27.711919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cce53305f654c5fa6058c4b02f18c41'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.788309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cce53305f654c5fa6058c4b02f18c41'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.798760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 889/1791] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:27 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:27.798760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:27.819873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8825f91-1669-496b-9c74-e45d75ea8ccb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:27.835458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cce53305f654c5fa6058c4b02f18c41'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.837146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cce53305f654c5fa6058c4b02f18c41'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.843310 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:27.845488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:27.845780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:27.846055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:27.846803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:27.848400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:27.872433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cce53305f654c5fa6058c4b02f18c41'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:27.889172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 890/1792] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:27.892871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:27.899666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:27.907785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 903/1793] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:27 2022] DELETE /identity/v3/users/1cce53305f654c5fa6058c4b02f18c41 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:27.918177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90d172-0adc-4979-b858-0b75a1748c47 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:28.011530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:28.086556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:28.088117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.090045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.090493 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.091707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:28.094270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831ff0a-3f77-4419-80fc-c94aebfbab52 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:28.128773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 891/1794] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:28.128952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:28.140453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a305fbc-c61e-4259-a7c2-daa42be7ee2c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:28.146716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:28.155190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.155541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.155826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] PATH_INFO: `/v3/projects/73ea582d203d4ca7b6a9b2023fafb1bb/users/4ae4e973af5c49bbb1cffdc085be3a30/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.189523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ea582d203d4ca7b6a9b2023fafb1bb, user_id=4ae4e973af5c49bbb1cffdc085be3a30, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:28.205240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:28.321377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 904/1795] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:28 2022] PUT /identity/v3/projects/73ea582d203d4ca7b6a9b2023fafb1bb/users/4ae4e973af5c49bbb1cffdc085be3a30/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:28.332235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.332407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.332736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.368091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] MFA Rules not processed for user `4ae4e973af5c49bbb1cffdc085be3a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:28.369510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:28.466016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 892/1796] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:28.466422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:28.563284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ddadc-7b19-4497-80cd-2243b720b7b1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:28.571939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:28.574621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.575186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.575683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.577131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:28.579888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d21782-aa90-4f84-a532-24b76b82ba58 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:28.688101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 905/1797] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:28 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:28.694847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:28.739102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409d950-e4f6-4614-b4c3-344f2eec55c2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:28.779108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b01a-5819-4516-9fb5-3e0f5438b45e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.779533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b01a-5819-4516-9fb5-3e0f5438b45e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.779914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5b01a-5819-4516-9fb5-3e0f5438b45e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.781450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 906/1798] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:28.945583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:28.947846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:28.955177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:28.955469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:28.961373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:28.966459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:29.075235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.075523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.075807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.122254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] MFA Rules not processed for user `231bf5521c35488f864e6bad34fdaf41`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:29.125486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:29.126931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 893/1799] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:28 2022] POST /identity/v3/users => generated 299 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:29.138717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.165180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2333e119-68b2-4fdf-99fc-365eac603da4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:29.173660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:29.174726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.175973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.176655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.179044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:29.188966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:29.222077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 894/1800] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:26:29.227066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.249854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c322594-a053-4ace-b03a-cbd317c89d16 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:29.259482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:29.265271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.265271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.265271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] PATH_INFO: `/v3/projects/dd834d022b64411ab0b861c038bae925/users/26ddf598885845e9b04aa4a18f56ddba/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.305945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd834d022b64411ab0b861c038bae925, user_id=26ddf598885845e9b04aa4a18f56ddba, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:29.310916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:29.360014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 907/1801] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:26:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:29.400329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 895/1802] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:29 2022] PUT /identity/v3/projects/dd834d022b64411ab0b861c038bae925/users/26ddf598885845e9b04aa4a18f56ddba/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:29.404492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.416758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1075194b-85e9-4344-a7f6-4508fb061d87 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:29.437740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:29.572177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:29.572972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.573556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.573556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.574357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:29.575998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:29.615630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.625943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 908/1803] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:29.633915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7269cf-81fa-4c55-8a42-130484c08028 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:29.647023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:29.651326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.651614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.651893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] PATH_INFO: `/v3/projects/dd834d022b64411ab0b861c038bae925/users/26ddf598885845e9b04aa4a18f56ddba/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.661850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd834d022b64411ab0b861c038bae925, user_id=26ddf598885845e9b04aa4a18f56ddba, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:29.665656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d6640-fabb-423d-8b76-720b5b4a4435 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:29.675137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.677946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:29.738613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 896/1804] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:29 2022] PUT /identity/v3/projects/dd834d022b64411ab0b861c038bae925/users/26ddf598885845e9b04aa4a18f56ddba/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:29.742274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:29.742591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:29.742901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:29.761324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:29.796546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] MFA Rules not processed for user `26ddf598885845e9b04aa4a18f56ddba`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:29.798180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:29.900467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c239001-1496-41e3-ba4b-e14098643b86 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:29.974572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 897/1805] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:29.976138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:29.990871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:30.075526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:30.076209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:30.076818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:30.076818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:30.088506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:30.090230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:30.113084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 909/1806] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:30.114065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:30.117967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:30.127328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65477b-fbc1-4faa-9d9e-ba7b11a5dbb7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:30.143357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:30.144365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688aa70-489c-4589-8975-1d9d77e16ffb service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:30.147815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:30.148211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:30.149284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] PATH_INFO: `/v3/projects/0352994c838940cf8dc6cbb8faa60908` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:30.152677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:30.153713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:30.153924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:30.154162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] PATH_INFO: `/v3/users/f1cf833664324c70b4266b5b45a196da` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:30.159343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1cf833664324c70b4266b5b45a196da)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:30.167240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0352994c838940cf8dc6cbb8faa60908)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:30.169491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:30.171116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:30.404665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:30.464517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1cf833664324c70b4266b5b45a196da'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.485057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0352994c838940cf8dc6cbb8faa60908', 'request_id': 'req-5a7830a6-f070-4439-9b0b-c071c5208c33'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.599742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0352994c838940cf8dc6cbb8faa60908', 'request_id': 'req-5a7830a6-f070-4439-9b0b-c071c5208c33'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.615415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0352994c838940cf8dc6cbb8faa60908', 'request_id': 'req-5a7830a6-f070-4439-9b0b-c071c5208c33'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.633609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] The token cache is being invalidate because project 0352994c838940cf8dc6cbb8faa60908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:30.639876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.639876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.641796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 898/1807] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:29 2022] DELETE /identity/v3/projects/0352994c838940cf8dc6cbb8faa60908 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:30.643246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:30.644908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:30.690160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1cf833664324c70b4266b5b45a196da'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.708924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:30.737862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1cf833664324c70b4266b5b45a196da'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.737862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1cf833664324c70b4266b5b45a196da'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.764735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec1d7336-0935-447f-990a-321ae00c7198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1cf833664324c70b4266b5b45a196da'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:30.806779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 910/1808] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:30 2022] DELETE /identity/v3/users/f1cf833664324c70b4266b5b45a196da => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:30.810679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c3af-cf09-460d-b743-b00b9145a86e None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:30.811607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c3af-cf09-460d-b743-b00b9145a86e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:30.812317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7c3af-cf09-460d-b743-b00b9145a86e None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:30.823922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 911/1809] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:26:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:30.825395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:30.826748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:30.827792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:30.878840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7830a6-f070-4439-9b0b-c071c5208c33 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:30.927260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:30.929592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.016023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:31.018241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.020853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.023760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.040569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.108249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 912/1810] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:31.119342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:31.121059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.145240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64cd0e-4b7e-4b75-855e-bb69b82ed058 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:31.163970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:31.164883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.166780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.167385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] PATH_INFO: `/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.174502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cad9c2474944e2b8bbdc9af7352e17b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:31.182052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:31.241209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:31.246367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013e263-4675-4f0c-addc-d4331840bfcd service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:31.288705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 899/1811] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:31.290278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.290634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.291175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.315170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:31.316937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.385061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cad9c2474944e2b8bbdc9af7352e17b', 'request_id': 'req-9c325a47-12d0-4581-814f-e2a35e76f68c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:31.488926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cad9c2474944e2b8bbdc9af7352e17b', 'request_id': 'req-9c325a47-12d0-4581-814f-e2a35e76f68c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:31.499574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cad9c2474944e2b8bbdc9af7352e17b', 'request_id': 'req-9c325a47-12d0-4581-814f-e2a35e76f68c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:31.534714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] The token cache is being invalidate because project 7cad9c2474944e2b8bbdc9af7352e17b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:31.535264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:31.536872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9c325a47-12d0-4581-814f-e2a35e76f68c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:31.541397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 913/1812] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:31 2022] DELETE /identity/v3/projects/7cad9c2474944e2b8bbdc9af7352e17b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:31.543053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd00ad8-ce0d-4e6d-ab14-a665c42b59cc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.544604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 900/1813] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:31.545172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd00ad8-ce0d-4e6d-ab14-a665c42b59cc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.545560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd00ad8-ce0d-4e6d-ab14-a665c42b59cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.557928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:31.562158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.583969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ddd00ad8-ce0d-4e6d-ab14-a665c42b59cc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:31.589756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ddd00ad8-ce0d-4e6d-ab14-a665c42b59cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.648951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c1a55f-5b2d-43e9-be0f-3d3f7fe64bf4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:31.691377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:31.703889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:31.830794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 914/1814] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:31.834404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f5c3-0727-4768-b677-1f94620c54d5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.837785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f5c3-0727-4768-b677-1f94620c54d5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.838282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f5c3-0727-4768-b677-1f94620c54d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.892770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:31.893875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.894424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.894944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] PATH_INFO: `/v3/users/4ae4e973af5c49bbb1cffdc085be3a30` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.899275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ae4e973af5c49bbb1cffdc085be3a30)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:31.904087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1726f5c3-0727-4768-b677-1f94620c54d5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:31.905534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:31.910442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1726f5c3-0727-4768-b677-1f94620c54d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:31.964992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 915/1815] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:31.966637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a950a-2a82-41ac-ba94-a81f26d3f691 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:31.967033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a950a-2a82-41ac-ba94-a81f26d3f691 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:31.969660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a950a-2a82-41ac-ba94-a81f26d3f691 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:31.971965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 916/1816] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:26:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:31.977179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a950a-2a82-41ac-ba94-a81f26d3f691 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:31.993451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a950a-2a82-41ac-ba94-a81f26d3f691 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:31.999951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:32.000989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.003392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.003941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.005012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:32.005701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:32.008316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591ed81-32dd-419e-ba12-6fda75facb29 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:32.054507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 917/1817] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:32.056193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2953-88b9-4659-9acd-1471bee21f5e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.056733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2953-88b9-4659-9acd-1471bee21f5e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.057255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa2953-88b9-4659-9acd-1471bee21f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.097133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-39fa2953-88b9-4659-9acd-1471bee21f5e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:32.099038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-39fa2953-88b9-4659-9acd-1471bee21f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.131325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 918/1818] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:32.133653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.133951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.134239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.154088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:32.155342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.173089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ae4e973af5c49bbb1cffdc085be3a30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:32.237501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 919/1819] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:32.238424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.250361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67108e-56dd-426f-a6d5-ea04c8c8b79d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:32.258703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:32.259577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.260020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.260295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.261012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:32.263030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a7539-027e-40e9-beec-2f9161ce2ed5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:32.272771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ae4e973af5c49bbb1cffdc085be3a30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:32.274856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ae4e973af5c49bbb1cffdc085be3a30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:32.304605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ae4e973af5c49bbb1cffdc085be3a30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:32.325107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ae4e973af5c49bbb1cffdc085be3a30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:32.343345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 901/1820] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:31 2022] DELETE /identity/v3/users/4ae4e973af5c49bbb1cffdc085be3a30 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:32.346356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.350033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.425541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 920/1821] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:32.428395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.430678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.431154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.477162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:32.478624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.585115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 921/1822] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:32.587457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.589343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.589639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975ed3a-2fbb-4403-ac48-a97c0a7eb101 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:32.596584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:32.597328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.597615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.597898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.599028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:32.601076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:32.606068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:32.644782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 902/1823] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:32.646217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.649145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.700847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06c069c-00e1-4a36-8375-850e413450e9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:32.724470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:32.726968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.728621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.729790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.731622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:32.734306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:32.769682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e981b-69c1-4e38-abac-e0bacf6c55e6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:32.777653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:32.782399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:32.784210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:32.784210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:32.784210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:32.793070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.812028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:32.820334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:32.858916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 922/1824] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:32.862105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.870502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:32.889382 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 903/1825] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:32.890494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:32.959532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef01a66-86e5-460b-b1f4-9e8702dadafa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.000065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.003023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.006765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.007392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.008480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.013171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.034759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:33.138098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099af465-ab47-4b95-a116-ccd3e7f9f998 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.144855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.144855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.144855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.144855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.156078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 904/1826] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:32 2022] POST /identity/v3/projects => generated 367 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:33.158487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.162522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:33.168838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.174154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.204461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 923/1827] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:33.205880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.227518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a9799-fe74-48d7-b9eb-7e071c455c1b service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.323837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.324612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.332449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff0175-2065-4955-af2a-2feccfcb155a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.336075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.336635 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.337647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.340655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.343319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.344345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.351561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.351561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.368326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:33.371275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 924/1828] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:33.372196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.374574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:33.398039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.401739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.403907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd692bb6-e26e-4777-b6db-09b97e6b7557 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.414535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.417331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 905/1829] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:33.419645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.434808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.436158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.440116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee591770-dc9d-4367-8a2d-70c9de1065e9 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.440371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] PATH_INFO: `/v3/projects/d34941d9f85c4b64960cd51e948fad14` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.440371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d34941d9f85c4b64960cd51e948fad14)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.445432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.446492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.447613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.448039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.448541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.449760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.452486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.612069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 906/1830] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:33 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:33.619187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.630304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:33.647598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f3a50-5d93-49ed-8000-7e92d3a1d319 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.661493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd34941d9f85c4b64960cd51e948fad14', 'request_id': 'req-93d69280-fc98-4017-b658-1af9f2ac7c20'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:33.723959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd34941d9f85c4b64960cd51e948fad14', 'request_id': 'req-93d69280-fc98-4017-b658-1af9f2ac7c20'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:33.734631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd34941d9f85c4b64960cd51e948fad14', 'request_id': 'req-93d69280-fc98-4017-b658-1af9f2ac7c20'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:33.777951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] The token cache is being invalidate because project d34941d9f85c4b64960cd51e948fad14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:33.778624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:33.780080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:33.787734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 925/1831] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:33 2022] DELETE /identity/v3/projects/d34941d9f85c4b64960cd51e948fad14 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:33.787734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.795627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:33.842529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.843419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.843999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.845050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.845935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.849056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.868992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 907/1832] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:33.870960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:33.873993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:33.910939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d66c75-7b74-402b-a161-17c18bbfa115 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:33.940880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:33.941994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:33.942590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:33.942590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] PATH_INFO: `/v3/users/634c4c7bba1d4218851fcba4c49c9019` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:33.945913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=634c4c7bba1d4218851fcba4c49c9019)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:33.947928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:33.989877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d69280-fc98-4017-b658-1af9f2ac7c20 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:34.011316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:34.015527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.015527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.015791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.016492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:34.018216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:34.053737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 926/1833] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:34.055262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:34.058258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:34.077928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2cd9b-d621-4b24-9ff5-edefc7f18ef2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:34.088298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:34.091321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.092233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.092804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] PATH_INFO: `/v3/projects/c4091588b9464aefa411e5676d50d1f7/users/91a2ef72ed63409bb6674ab64b0a9c33/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.134278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4091588b9464aefa411e5676d50d1f7, user_id=91a2ef72ed63409bb6674ab64b0a9c33, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:34.137288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:34.260723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 927/1834] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:34 2022] PUT /identity/v3/projects/c4091588b9464aefa411e5676d50d1f7/users/91a2ef72ed63409bb6674ab64b0a9c33/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:34.263581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:34.279325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634c4c7bba1d4218851fcba4c49c9019'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:34.288984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:34.374690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634c4c7bba1d4218851fcba4c49c9019'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:34.375744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634c4c7bba1d4218851fcba4c49c9019'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:34.402008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634c4c7bba1d4218851fcba4c49c9019'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:34.415157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-48f21462-a82b-4d9f-998f-13002d75fde3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634c4c7bba1d4218851fcba4c49c9019'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:34.429260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 908/1835] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:33 2022] DELETE /identity/v3/users/634c4c7bba1d4218851fcba4c49c9019 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:34.430444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.430838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.431213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.447680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7719c57-2dfa-43c8-a574-4a6a6392d976 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:34.472275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:34.473822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:34.525066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:34.546895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:34.548867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.549206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.549487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.550698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:34.554638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:34.567670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 909/1836] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:34.575739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 928/1837] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:34.577203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:34.587265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:34.625539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbb149e-c69b-4051-a451-d86fdc16338a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:34.629115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:34.631557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:34.651871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:34.652952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.654940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.655226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] PATH_INFO: `/v3/projects/6326b59c893e4a09adca4a221c630c0e/users/0d4bdce180834725990f4b34a2561b49/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.699275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6326b59c893e4a09adca4a221c630c0e, user_id=0d4bdce180834725990f4b34a2561b49, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:34.702584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3bfed-fd2d-4cee-a761-993daf64eed5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:34.756847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65470ef-57a4-4981-8c68-a2dfbb6af6bc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:34.771833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:34.774913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.775306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.775882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.806914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 910/1838] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:34 2022] PUT /identity/v3/projects/6326b59c893e4a09adca4a221c630c0e/users/0d4bdce180834725990f4b34a2561b49/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:34.809529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:34.810011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:34.810915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:34.811584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:34.821894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:34.850617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 929/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:34.873256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] MFA Rules not processed for user `0d4bdce180834725990f4b34a2561b49`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:34.874490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:34.998027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 911/1840] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:34.999425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:35.025207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6180ff-3a67-4c1e-b66e-dfac3edef0c4 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:35.214290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:35.215152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:35.215620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:35.216156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:35.217668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:35.220671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:35.371494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 930/1841] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:34 2022] POST /identity/v3/projects => generated 369 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:35.375679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:35.391445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fa0a2-b575-48f5-849d-12a0348ef3b9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:35.429565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:35.459655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:35.462684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:35.531385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:35.537830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:35.537830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:35.537830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:35.537830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:35.537830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:35.622229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107b8e5-4e6d-4277-8003-194582688602 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:35.628279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:35.629555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:35.630596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:35.631029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] PATH_INFO: `/v3/projects/73ea582d203d4ca7b6a9b2023fafb1bb` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:35.632952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ea582d203d4ca7b6a9b2023fafb1bb)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:35.637988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:35.660063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 912/1842] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:35 2022] POST /identity/v3/users => generated 291 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:35.665775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:35.676059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:35.701314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:35.730580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcefa8-b75b-407a-9fe1-1dec7e6e5783 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:35.740913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:35.751632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:35.753255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:35.753541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] PATH_INFO: `/v3/projects/078e164c04f546aaaef828d391215c8f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:35.756475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078e164c04f546aaaef828d391215c8f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:35.759348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:35.855921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ea582d203d4ca7b6a9b2023fafb1bb', 'request_id': 'req-47a1ece9-26d7-40c0-b296-2888c11dae75'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.929724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ea582d203d4ca7b6a9b2023fafb1bb', 'request_id': 'req-47a1ece9-26d7-40c0-b296-2888c11dae75'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.938887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078e164c04f546aaaef828d391215c8f', 'request_id': 'req-28329522-560e-46ed-ace6-5fef6ca91195'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.941145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ea582d203d4ca7b6a9b2023fafb1bb', 'request_id': 'req-47a1ece9-26d7-40c0-b296-2888c11dae75'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.968070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] The token cache is being invalidate because project 73ea582d203d4ca7b6a9b2023fafb1bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:35.968773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.970370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:35.977141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 931/1843] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:35 2022] DELETE /identity/v3/projects/73ea582d203d4ca7b6a9b2023fafb1bb => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:35.978633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:35.980664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.060125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078e164c04f546aaaef828d391215c8f', 'request_id': 'req-28329522-560e-46ed-ace6-5fef6ca91195'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.070701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078e164c04f546aaaef828d391215c8f', 'request_id': 'req-28329522-560e-46ed-ace6-5fef6ca91195'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.076341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1ece9-26d7-40c0-b296-2888c11dae75 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.097568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] The token cache is being invalidate because project 078e164c04f546aaaef828d391215c8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:36.098069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.099089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.111233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 913/1844] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:35 2022] DELETE /identity/v3/projects/078e164c04f546aaaef828d391215c8f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:36.112142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.116311 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.248852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329522-560e-46ed-ace6-5fef6ca91195 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.256759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.258061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.258612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.259042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.259902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.264456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6e9f-8461-4ade-877b-d8b52dc64245 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.264575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.264575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.264991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.265379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] PATH_INFO: `/v3/users/26ddf598885845e9b04aa4a18f56ddba` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.267155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ddf598885845e9b04aa4a18f56ddba)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.269450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.283957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 932/1845] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:36.289404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.290111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.294492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.334533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:36.336289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.365496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 933/1846] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:36.365496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.365496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.380448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac81267-13cb-42c2-b89a-ef798b3094cc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.390987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.392166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.392528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.392820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] PATH_INFO: `/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936/users/a6e12d5c677f4bd19a3e23e32fbc20ac/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.430856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae58137780ad4c19bdf5b7ec7b13b936, user_id=a6e12d5c677f4bd19a3e23e32fbc20ac, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.433701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768946c-aba2-4a30-9721-dc1b2204ed98 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.478240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ddf598885845e9b04aa4a18f56ddba'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.480213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82,keystone:INSERT=4,keystone:DELETE=14 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:36.533261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 934/1847] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:36 2022] PUT /identity/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936/users/a6e12d5c677f4bd19a3e23e32fbc20ac/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:36.533261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.533261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.533613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.552210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ddf598885845e9b04aa4a18f56ddba'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.552829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ddf598885845e9b04aa4a18f56ddba'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.574670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ddf598885845e9b04aa4a18f56ddba'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.589913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ddf598885845e9b04aa4a18f56ddba'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:36.603045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 914/1848] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:36 2022] DELETE /identity/v3/users/26ddf598885845e9b04aa4a18f56ddba => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:36.604005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.606646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.631874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:36.633214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:36.652458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:36.764273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ef901-986f-4d59-bdce-4084767cdb5c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.771169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.773269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.773977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.774592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.777323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.779433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.793795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 915/1850] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:36.794048 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 935/1850] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:36.795203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.797014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.809972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43870cb4-dc48-45ef-9b8e-be21cd4db4ba None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.816464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.817731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.818081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.818359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.819519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:36.819519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.821379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.829218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e76c-26df-430b-80e0-6559a610f2c1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.842578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.845805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.845805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.845805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] PATH_INFO: `/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936/users/a6e12d5c677f4bd19a3e23e32fbc20ac/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.846997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 936/1851] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:36.847623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae58137780ad4c19bdf5b7ec7b13b936, user_id=a6e12d5c677f4bd19a3e23e32fbc20ac, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.847905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:36.850821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c1bfb-fc89-42ca-b074-4d6426b7d8e5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.861690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898cb08-4c21-4f15-82eb-68f47243fe0d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:36.869969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:36.871135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.871337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.874482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.874482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:36.875403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:36.884594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 916/1852] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:36 2022] PUT /identity/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936/users/a6e12d5c677f4bd19a3e23e32fbc20ac/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:36.896703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:36.925974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:36.925974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:36.932384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] MFA Rules not processed for user `a6e12d5c677f4bd19a3e23e32fbc20ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:36.933869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:37.099319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 917/1853] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:37.111134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.116147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:37.144223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 937/1854] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:36 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:37.148625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.184071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:37.236036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbd618-b36d-45c6-b43d-d67775170104 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.311682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.313246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.313616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.313965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.315503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5e47a-0094-4d28-9948-3fa50ba750d6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.322093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.322302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.322501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.322779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.323939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.326203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.387164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.388623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.404906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 918/1855] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:37 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:37.465864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 938/1856] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:37 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:37.466869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.480443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d9a6b-0679-4636-8677-3ba6e797e7b8 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.486470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.487233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.487776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.488063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.488805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.490748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.503008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 919/1857] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:37.507445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.530220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1af5-4294-4e1b-9481-7c83b288214d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.541339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.542536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.542889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.543287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.544142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.550381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da407b30-4341-4001-b6fc-75a8fcd45274 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.564858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 939/1858] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:37.566135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.580599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5be59-1baa-4ec3-bdce-d12765273366 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.587892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.589032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.589425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.589820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] PATH_INFO: `/v3/projects/c06ca865fb7b495499ce562f3ee0375e/users/650e8c959ca44ebf8f6606333f6aab30/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.608928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06ca865fb7b495499ce562f3ee0375e, user_id=650e8c959ca44ebf8f6606333f6aab30, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.611778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.690541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 920/1859] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:37 2022] PUT /identity/v3/projects/c06ca865fb7b495499ce562f3ee0375e/users/650e8c959ca44ebf8f6606333f6aab30/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:37.703358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.703652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.703931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.734290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] MFA Rules not processed for user `650e8c959ca44ebf8f6606333f6aab30`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:37.735482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:37.796782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:37.805061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.805061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:37.843351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 940/1860] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:37.859036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:37.953337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f04348-dc33-4169-8155-29031a7d3eb9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.964632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.965249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.965522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.965808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] PATH_INFO: `/v3/projects/dd834d022b64411ab0b861c038bae925` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.967438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd834d022b64411ab0b861c038bae925)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.973078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:37.973294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3760fc5-e706-4648-8fb2-7d654bf1cfa8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:37.977726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:37.979930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:37.979930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:37.979930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:37.980786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:37.983316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.076882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 941/1861] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:37 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:38.078521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.118096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:38.147417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd834d022b64411ab0b861c038bae925', 'request_id': 'req-4f78d771-731a-4423-ad9d-8b8a59d5d84a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:38.171425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d9d9e-90a2-4993-aca6-6ce7cb6726c1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.225856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd834d022b64411ab0b861c038bae925', 'request_id': 'req-4f78d771-731a-4423-ad9d-8b8a59d5d84a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:38.233104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd834d022b64411ab0b861c038bae925', 'request_id': 'req-4f78d771-731a-4423-ad9d-8b8a59d5d84a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:38.239117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.240059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.240450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.241096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.242018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.244154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e9a7a-1db6-4975-8d68-8e7b50aea298 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.252145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] The token cache is being invalidate because project dd834d022b64411ab0b861c038bae925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:38.252790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:38.253720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4f78d771-731a-4423-ad9d-8b8a59d5d84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:38.257795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 921/1862] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:37 2022] DELETE /identity/v3/projects/dd834d022b64411ab0b861c038bae925 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:38.258703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.259204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.260471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.298166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] MFA Rules not processed for user `91a2ef72ed63409bb6674ab64b0a9c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:38.299795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.370101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 942/1863] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:38.371918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.372219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.377382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.379094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 922/1864] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:38.380629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.382293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.398397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:38.398397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:38.399239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab12b8d-8db1-4694-96a7-95df5e806571 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.399644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.403778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.404441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.404719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.404989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.405746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.407412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf58d96-1b59-4f73-92a8-4026a2218739 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.415966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 943/1865] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:38.415966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.417731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.421729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 923/1866] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:38.423017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.423305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.423580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.434346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183aa623-bc7f-42dc-bfd1-cb65ee271a72 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.439617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.440413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.440796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.441252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.442641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.444627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.446179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:38.447653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.456250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 924/1867] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:38.456911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.467054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ba85-d8bf-4e53-bcd1-a483561c4e4f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.471878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.472767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.473084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.473424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] PATH_INFO: `/v3/projects/bfd0c9634658426fb5933baa69717825/users/6013e72fad564834b532a867dcd790fb/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.488251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd0c9634658426fb5933baa69717825, user_id=6013e72fad564834b532a867dcd790fb, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.491943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.510828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 944/1868] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:38.510828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.558891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 925/1869] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:38 2022] PUT /identity/v3/projects/bfd0c9634658426fb5933baa69717825/users/6013e72fad564834b532a867dcd790fb/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:38.559789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.577425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17ab8a-d78f-4222-a3ab-669d58eda5e4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.609259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:38.626980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a82009-05ac-4904-b875-14c2b962ce67 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.632284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.633049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.633340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.633620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.634321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.636314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.641082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.641965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.642339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.642780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.643575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:38.644408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.646340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.659536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 945/1870] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:38.660754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.672691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f10129-7c59-45eb-8f76-49d4c1ed9f68 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.678867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.679662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.680035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.680378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.681144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.682731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.693060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 946/1871] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:38.693775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.703342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b1e0-501f-46ab-ad5b-1e07972c3451 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.708495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.709167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.709450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.709726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.710441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.712555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf35df-1a75-4b72-a5ea-ed5f599f5f46 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.732359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 926/1872] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:38.732359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.740699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e4647-040a-4b57-ac41-e6d85b1b2390 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.745692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.746589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.746900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.747193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] PATH_INFO: `/v3/projects/bfd0c9634658426fb5933baa69717825/users/6013e72fad564834b532a867dcd790fb/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.749381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfd0c9634658426fb5933baa69717825, user_id=6013e72fad564834b532a867dcd790fb, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.752029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.765820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 927/1873] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:38 2022] PUT /identity/v3/projects/bfd0c9634658426fb5933baa69717825/users/6013e72fad564834b532a867dcd790fb/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:38.766901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.816025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 947/1874] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:38.820589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.820872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.821181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.840992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2071-db81-498f-ab1e-b216db039ed1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.850028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] MFA Rules not processed for user `6013e72fad564834b532a867dcd790fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:38.851257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:38.891770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:38.912923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.913718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.913998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.914280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.915015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.917386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.932676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 928/1875] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:38 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:38.932676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.940193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 948/1876] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:38.941537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:38.945700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fef46-6640-4667-b3e9-ed05abcc7111 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.951964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.952689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.952986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.953296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.954002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.961555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:38.961645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53a99d-7eb3-4da4-aa9f-50fceeeddf29 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:38.966403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:38.967588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:38.968021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:38.969321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] PATH_INFO: `/v3/projects/c2565ff79301421497b55d44a4723c5f/users/442b1ed8fce2412dbec8f72e83c54957/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:38.986729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2565ff79301421497b55d44a4723c5f, user_id=442b1ed8fce2412dbec8f72e83c54957, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:38.991087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.046277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 929/1877] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:38 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:39.047405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.050056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:39.089738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 949/1878] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:38 2022] PUT /identity/v3/projects/c2565ff79301421497b55d44a4723c5f/users/442b1ed8fce2412dbec8f72e83c54957/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:39.089738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.124053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:39.143289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b00f8-f405-4bc0-a9ab-02cc1bea4741 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.169430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2bda7-27e9-4138-b0bf-63b63b487dd6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.176218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.176928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.177268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.177542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.178356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.179965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.190321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 950/1879] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:39.191072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.200731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.200909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2fc5b-b87a-4e8e-a45f-9d8c64d00cef admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.201340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.201759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.202048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.206316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.207162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.208045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.208372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.209528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.212542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.225234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 951/1880] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:39.227242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.238071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e7c5bf-121d-42eb-b53a-7043a8f95b18 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.243222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.243875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.244159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.244434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.245214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.246803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.258331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 952/1881] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:39.258934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.268338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032cd64-2043-4e1d-8dcd-e6074bef3cdb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.273158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.273811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.274069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.274356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.274628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] PATH_INFO: `/v3/projects/c2565ff79301421497b55d44a4723c5f/users/442b1ed8fce2412dbec8f72e83c54957/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.275286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.276764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2565ff79301421497b55d44a4723c5f, user_id=442b1ed8fce2412dbec8f72e83c54957, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.279803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3550f702-b6f3-4327-86d3-8ee0e97d7daf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.291717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 930/1882] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:39.291717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.292068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 953/1883] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:39 2022] PUT /identity/v3/projects/c2565ff79301421497b55d44a4723c5f/users/442b1ed8fce2412dbec8f72e83c54957/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:39.296103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d4c2dd-626a-4ccc-8f9c-be146e172247 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.359794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.359794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.359794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.359794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] PATH_INFO: `/v3/projects/b85d9fabbbf9463e80037ec778472d03/users/1878bada1624424190836f8ff13a57a3/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.384740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85d9fabbbf9463e80037ec778472d03, user_id=1878bada1624424190836f8ff13a57a3, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.384740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.478906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 931/1884] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:39 2022] PUT /identity/v3/projects/b85d9fabbbf9463e80037ec778472d03/users/1878bada1624424190836f8ff13a57a3/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:39.490059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.491436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.491974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.522552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] MFA Rules not processed for user `1878bada1624424190836f8ff13a57a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:39.524132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:39.648391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:39.655424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 954/1885] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:39.660056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.700206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:39.732383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e78a-e888-48a7-91a6-979651535e89 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.740789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.740789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.740789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.740789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.741794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.741794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:39.850515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 932/1886] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:39 2022] POST /identity/v3/projects => generated 401 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:39.854609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:39.865547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18723ae1-7253-4735-8dbd-53293f3c93bb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:39.925008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:39.925752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:39.926043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:39.926864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:39.927643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:39.929609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.071705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 955/1887] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:39 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:40.076278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.089284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5934d4a-d686-4991-a229-1cda421c45fb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.106093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.106887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.107139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.107446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.108195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.109858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.122717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 933/1888] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:40.126672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.137501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d04354-dcd3-4e62-b7bb-24f266d43c98 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.144905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.150001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.150374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.150653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] PATH_INFO: `/v3/projects/ff203f14ac0b47c4b27dbb9854112b29/users/5d20d543ba3a4cf088267b46a4d7c279/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.166385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff203f14ac0b47c4b27dbb9854112b29, user_id=5d20d543ba3a4cf088267b46a4d7c279, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.169627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.257788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 956/1889] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:40 2022] PUT /identity/v3/projects/ff203f14ac0b47c4b27dbb9854112b29/users/5d20d543ba3a4cf088267b46a4d7c279/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:40.260698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.271810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be205b64-158d-45f3-8549-499e0ee23a53 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.341361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.342048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.342335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.342615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.343349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.344993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4262a-e821-4246-88ab-ca19db9e28a5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.355575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 934/1890] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:40.359760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.370596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291724ce-5bd8-4f7e-aab5-10600c6a2e6a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.379127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.379127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.379127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.379127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] PATH_INFO: `/v3/projects/ff203f14ac0b47c4b27dbb9854112b29/users/5d20d543ba3a4cf088267b46a4d7c279/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.380134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff203f14ac0b47c4b27dbb9854112b29, user_id=5d20d543ba3a4cf088267b46a4d7c279, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.382012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.397100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 957/1891] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:40 2022] PUT /identity/v3/projects/ff203f14ac0b47c4b27dbb9854112b29/users/5d20d543ba3a4cf088267b46a4d7c279/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:40.406379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.406667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.410418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.450007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] MFA Rules not processed for user `5d20d543ba3a4cf088267b46a4d7c279`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:40.451287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:40.472880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.525364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 935/1892] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:40 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:40.545233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.567880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d2a14-61bb-4dee-b03f-0968519986da admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.583771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6013e72fad564834b532a867dcd790fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfd0c9634658426fb5933baa69717825', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.585067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.585534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.586286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.587238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:40.587704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.590050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.595625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:40.608983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 958/1893] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:40.614750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.633141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58037b42-e7e0-4eda-9032-b2f28ff1567e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.637062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.637540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd1343-7a75-40fb-a405-64a8e805a7aa tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.638082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.638507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.639094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.644231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6013e72fad564834b532a867dcd790fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfd0c9634658426fb5933baa69717825', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.645312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.645739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.647783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.647783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.649749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.653609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.655320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.673544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 936/1894] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:40.757433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.758885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:40.759897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 959/1895] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:40 2022] POST /identity/v3/projects => generated 355 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:40.769534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:40.836329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:40.879550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5d71f-5766-4fea-9cbf-57ba59df95c5 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.884779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6013e72fad564834b532a867dcd790fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfd0c9634658426fb5933baa69717825', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:40.885507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:40.885937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:40.886342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:40.887155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:40.887460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:40.889208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:40.912120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccbee-99c2-407d-9d1c-a21af11a6649 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:40.913412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 960/1896] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:40.914847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:41.012657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f281cb-1ed0-4c16-b320-82a37e565556 tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:41.017448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:41.018145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.019021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.019307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.027891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:41.028787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.029307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.029486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] PATH_INFO: `/v3/users/0d4bdce180834725990f4b34a2561b49` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.031709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4bdce180834725990f4b34a2561b49)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:41.034080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:41.087928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:41.089573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30579cd9-4824-408f-b6e6-4319f4740393 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:41.099716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 961/1897] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:41.101145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.101440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.106622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.136673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] MFA Rules not processed for user `442b1ed8fce2412dbec8f72e83c54957`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:41.141099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.205924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4bdce180834725990f4b34a2561b49'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.271955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4bdce180834725990f4b34a2561b49'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.272142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4bdce180834725990f4b34a2561b49'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.277187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 962/1898] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:41.283879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:41.291818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4bdce180834725990f4b34a2561b49'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.295485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79120239-03f1-4efb-8a2f-520c99a91bf7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:41.301855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6013e72fad564834b532a867dcd790fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bfd0c9634658426fb5933baa69717825', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:41.307151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-2fa04bfd-6ba2-42ad-b323-19700b43497d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4bdce180834725990f4b34a2561b49'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.307279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.307279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.307279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] PATH_INFO: `/v3/projects/5f707bd86adf409397b1f882e48ecdb6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.307279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5f707bd86adf409397b1f882e48ecdb6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:41.307581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:41.310820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 937/1899] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:40 2022] DELETE /identity/v3/users/0d4bdce180834725990f4b34a2561b49 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:41.312326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4dc5-5f97-4994-930a-37c769de169b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.312622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4dc5-5f97-4994-930a-37c769de169b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.312904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedb4dc5-5f97-4994-930a-37c769de169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.337193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fedb4dc5-5f97-4994-930a-37c769de169b None None] MFA Rules not processed for user `91a2ef72ed63409bb6674ab64b0a9c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:41.338662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fedb4dc5-5f97-4994-930a-37c769de169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.396782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 938/1900] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:41.398697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.398697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.398902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.422813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f707bd86adf409397b1f882e48ecdb6', 'request_id': 'req-59c622b8-db73-4cab-a749-788e5866683a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.422975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:41.424074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.465779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f707bd86adf409397b1f882e48ecdb6', 'request_id': 'req-59c622b8-db73-4cab-a749-788e5866683a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.470572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:41.472566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f707bd86adf409397b1f882e48ecdb6', 'request_id': 'req-59c622b8-db73-4cab-a749-788e5866683a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.484862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] The token cache is being invalidate because project 5f707bd86adf409397b1f882e48ecdb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:41.484862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.485641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:41.487558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 963/1901] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:41 2022] DELETE /identity/v3/projects/5f707bd86adf409397b1f882e48ecdb6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:41.490316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:41.491643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.497278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 939/1902] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:41.507290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:41.508685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.590226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c622b8-db73-4cab-a749-788e5866683a tempest-VolumeQuotaClassesTest-1472446113 tempest-VolumeQuotaClassesTest-1472446113-project-admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:41.595955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6560703-7818-4bf5-a16f-8fc88f4da1cf None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:41.596744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:41.597614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.597912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.598216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.600078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:41.600290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:41.601001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:41.601404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:41.601776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:41.611714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:41.613257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:41.623727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 940/1903] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:41.662648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:41.664840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:41.674331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 964/1904] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:41.837678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:42.202312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:42.203831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:42.223002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f7482-bbf2-42be-ae61-d23d6feedcc9 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:42.223002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:42.224468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:42.225206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:42.225206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] PATH_INFO: `/v3/users/650e8c959ca44ebf8f6606333f6aab30` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:42.226265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=650e8c959ca44ebf8f6606333f6aab30)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:42.229783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:42.389903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:42.394359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:42.413126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f7cbf9-41ec-463c-95ec-9419ca4befb3 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:42.421615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:42.422758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:42.423666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:42.423666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] PATH_INFO: `/v3/projects/6326b59c893e4a09adca4a221c630c0e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:42.424834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6326b59c893e4a09adca4a221c630c0e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:42.427399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:42.803721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '650e8c959ca44ebf8f6606333f6aab30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.342688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6326b59c893e4a09adca4a221c630c0e', 'request_id': 'req-07ca74cb-f0c3-46fd-b704-0f50ad10235c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.432612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '650e8c959ca44ebf8f6606333f6aab30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.433585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '650e8c959ca44ebf8f6606333f6aab30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.437546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:43.449947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '650e8c959ca44ebf8f6606333f6aab30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.459059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-071452bf-ad00-4ecc-a2e2-0a04aa5c3489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '650e8c959ca44ebf8f6606333f6aab30'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.470865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 941/1905] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:42 2022] DELETE /identity/v3/users/650e8c959ca44ebf8f6606333f6aab30 => generated 0 bytes in 1269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:43.476103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.476566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.477095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.482311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6326b59c893e4a09adca4a221c630c0e', 'request_id': 'req-07ca74cb-f0c3-46fd-b704-0f50ad10235c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.493949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6326b59c893e4a09adca4a221c630c0e', 'request_id': 'req-07ca74cb-f0c3-46fd-b704-0f50ad10235c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.500882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:43.503004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:43.508390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] The token cache is being invalidate because project 6326b59c893e4a09adca4a221c630c0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:43.508818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.509659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.511922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 965/1906] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:42 2022] DELETE /identity/v3/projects/6326b59c893e4a09adca4a221c630c0e => generated 0 bytes in 1122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:43.518403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:43.518403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:43.616627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 942/1907] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:43.623641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:43.624022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ca74cb-f0c3-46fd-b704-0f50ad10235c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:43.625921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:43.636716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:43.637825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.638187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.638662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] PATH_INFO: `/v3/users/a6e12d5c677f4bd19a3e23e32fbc20ac` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.639911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e12d5c677f4bd19a3e23e32fbc20ac)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:43.642382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:43.697607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563831a-b933-4f19-99c0-a1aa6c21d355 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:43.701501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:43.702164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.702591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.702890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.717164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:43.719812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f2c484-f7f6-48b2-afcd-064800653b58 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:43.736472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 943/1908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:43.737728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4076-3a25-422e-b71e-266ff97ea438 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.738022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4076-3a25-422e-b71e-266ff97ea438 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.738306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9c4076-3a25-422e-b71e-266ff97ea438 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.742047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 944/1909] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:26:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:26:43.752586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.752992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.753386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.783601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:43.785075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:43.864386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 945/1910] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:26:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:43.879140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:43.881275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:43.893101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e12d5c677f4bd19a3e23e32fbc20ac'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:43.901547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0d3cff-3a63-4e04-baba-cab72eb14927 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:43.907594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:43.908255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:43.908696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:43.908801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:43.921182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:43.922803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:43.943329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 946/1911] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:44.003141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e12d5c677f4bd19a3e23e32fbc20ac'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.042124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e12d5c677f4bd19a3e23e32fbc20ac'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.044051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e12d5c677f4bd19a3e23e32fbc20ac'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.050778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e12d5c677f4bd19a3e23e32fbc20ac'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.060621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 966/1912] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:43 2022] DELETE /identity/v3/users/a6e12d5c677f4bd19a3e23e32fbc20ac => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:44.299447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:44.300900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:44.330445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd858997-8312-40c7-a5dc-5e9e473bca98 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:44.347496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:44.516105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:44.517169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:44.517594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:44.517952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] PATH_INFO: `/v3/projects/c06ca865fb7b495499ce562f3ee0375e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:44.520154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06ca865fb7b495499ce562f3ee0375e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:44.524373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:44.557492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:44.559425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:44.580324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acd772-25b4-4be8-876c-ccf2374ed594 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:44.603834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:44.607055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:44.607359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:44.607636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] PATH_INFO: `/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:44.610676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae58137780ad4c19bdf5b7ec7b13b936)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:44.612644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:44.734142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06ca865fb7b495499ce562f3ee0375e', 'request_id': 'req-220e679d-9e3c-4c22-bf60-0be6d6b22383'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.788523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae58137780ad4c19bdf5b7ec7b13b936', 'request_id': 'req-58ed8c78-236a-4ca9-98a0-a5490917f1b0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.854553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06ca865fb7b495499ce562f3ee0375e', 'request_id': 'req-220e679d-9e3c-4c22-bf60-0be6d6b22383'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.865359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06ca865fb7b495499ce562f3ee0375e', 'request_id': 'req-220e679d-9e3c-4c22-bf60-0be6d6b22383'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.884466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] The token cache is being invalidate because project c06ca865fb7b495499ce562f3ee0375e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:44.889255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.889255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.889255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 947/1913] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:44 2022] DELETE /identity/v3/projects/c06ca865fb7b495499ce562f3ee0375e => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:44.890998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:44.892533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:44.951464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae58137780ad4c19bdf5b7ec7b13b936', 'request_id': 'req-58ed8c78-236a-4ca9-98a0-a5490917f1b0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.962044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae58137780ad4c19bdf5b7ec7b13b936', 'request_id': 'req-58ed8c78-236a-4ca9-98a0-a5490917f1b0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.976299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e679d-9e3c-4c22-bf60-0be6d6b22383 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:44.982171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] The token cache is being invalidate because project ae58137780ad4c19bdf5b7ec7b13b936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:44.982451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.983116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58ed8c78-236a-4ca9-98a0-a5490917f1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:44.988219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 967/1914] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:44 2022] DELETE /identity/v3/projects/ae58137780ad4c19bdf5b7ec7b13b936 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:44.991017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31775bc-bb38-4830-b641-c71dc3660aaf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:44.991308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31775bc-bb38-4830-b641-c71dc3660aaf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:44.991582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31775bc-bb38-4830-b641-c71dc3660aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.016104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d31775bc-bb38-4830-b641-c71dc3660aaf None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:45.016104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d31775bc-bb38-4830-b641-c71dc3660aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:45.044148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.045159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.045535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.045992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] PATH_INFO: `/v3/users/6013e72fad564834b532a867dcd790fb` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.047271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6013e72fad564834b532a867dcd790fb)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.049231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.079324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 968/1915] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:45.088275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.091542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.091542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.107670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:45.108886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:45.118385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 969/1916] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:45.125662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.133243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e623589-a9f8-4d54-9bce-b00efc874ecb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.138627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.139312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.139907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.140201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.140936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:45.141295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.142871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.155762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 970/1917] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:26:45.159871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.171737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e05e09-8489-410d-b51b-b146072af855 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.176648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.177415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.177684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.177964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.178689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.180674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.296011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 971/1918] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:45 2022] POST /identity/v3/projects => generated 409 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:45.300010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.302954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6013e72fad564834b532a867dcd790fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:45.362949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6013e72fad564834b532a867dcd790fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:45.363765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6013e72fad564834b532a867dcd790fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:45.364502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e553be50-786b-40a8-895f-b08d85da5a61 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.369794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.370582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.370956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.371208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.371906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.373890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.376478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6013e72fad564834b532a867dcd790fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:45.383619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6013e72fad564834b532a867dcd790fb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:45.389585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 948/1919] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:44 2022] DELETE /identity/v3/users/6013e72fad564834b532a867dcd790fb => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:45.391219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:45.494865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:45.501299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 972/1920] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:45 2022] POST /identity/v3/users => generated 305 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:45.506009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.507756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:45.596560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90547d56-ad4a-4cfa-9742-c8d52bcbfc15 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.602235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.603375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.603959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.604823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.605890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.608034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.627131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.649113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 949/1921] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:45.655296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6428ebc-d1d2-448c-8c17-4ba7418fcee1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.662556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.663394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.663682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.663956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.665459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.667682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fb2a7-53c2-46e4-a873-7e0170e107ca admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.681827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 973/1922] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:45.686784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.700671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cea8c-aa48-4799-90d4-ae6e2f7ff67a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.706941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.707974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.708259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.709078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] PATH_INFO: `/v3/projects/40410030cf1a4a6799ca6d4a92927458/users/efe0354df6f24e878d07fcbf120ccefc/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.728364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40410030cf1a4a6799ca6d4a92927458, user_id=efe0354df6f24e878d07fcbf120ccefc, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.735592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.792685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 950/1923] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:45 2022] PUT /identity/v3/projects/40410030cf1a4a6799ca6d4a92927458/users/efe0354df6f24e878d07fcbf120ccefc/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:45.805569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.806204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.806350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.813485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.814793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:45.873946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] MFA Rules not processed for user `efe0354df6f24e878d07fcbf120ccefc`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:45.875759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:45.917373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d3bc7-e3fe-4c95-8878-c001a9fb2958 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.923048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.924002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.924290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.924566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] PATH_INFO: `/v3/projects/bfd0c9634658426fb5933baa69717825` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.925954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfd0c9634658426fb5933baa69717825)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.928800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:45.958711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 974/1924] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:45.959733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:45.970898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45935235-73f5-48b9-b45a-b481e3181487 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:45.976391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:45.977113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:45.977401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:45.977677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:45.978368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:45.980294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.083741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfd0c9634658426fb5933baa69717825', 'request_id': 'req-1c6081f2-cc26-4e70-930e-2b22386dd9c9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:46.103855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 975/1925] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:45 2022] POST /identity/v3/projects => generated 407 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:46.107993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.174263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfd0c9634658426fb5933baa69717825', 'request_id': 'req-1c6081f2-cc26-4e70-930e-2b22386dd9c9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:46.183565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfd0c9634658426fb5933baa69717825', 'request_id': 'req-1c6081f2-cc26-4e70-930e-2b22386dd9c9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:46.189472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147b53e-8e6d-4868-815f-6c0ece674294 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.195944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.198189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.198189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.198189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.198747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.199275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] The token cache is being invalidate because project bfd0c9634658426fb5933baa69717825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:46.199578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:46.200258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1c6081f2-cc26-4e70-930e-2b22386dd9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:46.200681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.202788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 951/1926] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:45 2022] DELETE /identity/v3/projects/bfd0c9634658426fb5933baa69717825 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:46.208002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239536-39fc-4cd0-8f41-d6793b0b3e67 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.208610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239536-39fc-4cd0-8f41-d6793b0b3e67 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.209117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a239536-39fc-4cd0-8f41-d6793b0b3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.237662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-4a239536-39fc-4cd0-8f41-d6793b0b3e67 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:46.239758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4a239536-39fc-4cd0-8f41-d6793b0b3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:46.262659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 952/1927] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:46.264570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.264961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.265321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.288048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:46.289212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:46.302308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 953/1929] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:46.303473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.306448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:46.312013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 976/1928] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/users => generated 310 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:46.313005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.313853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb85c4b-6b2c-403d-a1ab-3279d7fc5d06 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.314978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:46.319340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.320200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.320563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.320768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.321969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:46.322076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.323965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.339301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f643b-9424-417d-b063-6d098d127b78 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.340101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 954/1930] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:46.345053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.345426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.346424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.346586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.346971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.347816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.350626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.362520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea219a-4323-4f63-818d-7d3bf11ba2ee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.362877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 977/1931] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:46.364259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.365128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.365514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.365884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.366819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.368524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.369119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.380180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6718-3773-4395-8a3c-7f1bc037b2bd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.384536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:46.385339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.386397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.386746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.387117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] PATH_INFO: `/v3/projects/23a774dd8f6c4cd79da444611ee1d228/users/0feec536a744410582186e19599c3147/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.404204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a774dd8f6c4cd79da444611ee1d228, user_id=0feec536a744410582186e19599c3147, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.407121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.524925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 978/1932] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:46 2022] PUT /identity/v3/projects/23a774dd8f6c4cd79da444611ee1d228/users/0feec536a744410582186e19599c3147/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:46.529060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.531403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 955/1933] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:46.538714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.603092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9c3453-fd2e-4c24-9d7c-2e6b45e4acff admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.631962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cb9f3-6ba4-4d67-a3a8-bcc5bc27af4b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.646478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.647312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.647721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.648035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.648843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.653686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.684016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.684699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.684988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.685379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.686122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.687718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.699159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 979/1934] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:46.704004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.714187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f9488-72d0-43be-a0f9-5090ba6e0afb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.720489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.721972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.722373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.723216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] PATH_INFO: `/v3/projects/23a774dd8f6c4cd79da444611ee1d228/users/0feec536a744410582186e19599c3147/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.724823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a774dd8f6c4cd79da444611ee1d228, user_id=0feec536a744410582186e19599c3147, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.727597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add3991-afaf-465f-92b4-22bc41aea744 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.742658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 980/1935] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:46 2022] PUT /identity/v3/projects/23a774dd8f6c4cd79da444611ee1d228/users/0feec536a744410582186e19599c3147/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:46.753199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.754001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.755267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.776631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 956/1936] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:46.778244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.802782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] MFA Rules not processed for user `0feec536a744410582186e19599c3147`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:46.804263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:46.807773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d028fc-dce7-43c3-9343-ae0abd9be0b1 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:46.916562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:46.918027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:46.918826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:46.919637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:46.920728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:46.922901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:46.939749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 981/1937] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:46 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:46.941315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 957/1938] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:46.946301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.983392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:46.985787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:46.987451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b76ac-9f6b-416a-b775-ebb458da1ae3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.000475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.001452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.001452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.006568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.006568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.007763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.036445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 982/1939] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:47.037949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.052985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4d4933-5b21-44ad-901a-5065d637da51 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.059335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.060458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.060885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.061340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] PATH_INFO: `/v3/projects/8de84988456a41c7aa1504a95c764c8b/users/737c6ed303454738a92b449f77986d1c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.071631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee536d3-d32c-41b1-b8d2-2d0e935cfc15 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.076236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.076921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.077309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.077598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.089193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de84988456a41c7aa1504a95c764c8b, user_id=737c6ed303454738a92b449f77986d1c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.089430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.090889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16761-7d11-4586-aee5-6966bed09275 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.093270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.107506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 958/1940] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:46 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:47.199576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 983/1941] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:47 2022] PUT /identity/v3/projects/8de84988456a41c7aa1504a95c764c8b/users/737c6ed303454738a92b449f77986d1c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:47.213190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.213565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.213915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.252513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:47.273316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] MFA Rules not processed for user `737c6ed303454738a92b449f77986d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:47.274669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:47.334293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:47.427043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 959/1942] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:47.429102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.532273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9f3a0-aaad-4433-a6a7-a7414ef55c05 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.537726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.539311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.539311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.539311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.539743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.541756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.646219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.655896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 984/1943] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:47.660217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31236e-ae8e-4fb7-bc1d-d2e09b058aa0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.706401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.708945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:47.770217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.771279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.771728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.772165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.773428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.775915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.819134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02bc88-792b-4b0a-8b85-9a42a03220fd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.822861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.824313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.824602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.824881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.826739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:47.873614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 960/1944] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:47 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:47.875027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.878637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:47.894546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e0098-df5c-4d05-8beb-1e4c44384554 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.901944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.903280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.904090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.904973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] PATH_INFO: `/v3/users/1878bada1624424190836f8ff13a57a3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.906569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1878bada1624424190836f8ff13a57a3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.909414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.922894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:47.929226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.930988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.942278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 985/1945] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:47.943166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:47.963227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2642c-faef-489c-ac14-a19a0d3122d8 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:47.976041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:47.977399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:47.977399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:47.977851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:47.978649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:47.980838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:47.999553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 986/1946] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:48.007696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.029890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e30268-e4d8-437a-8569-687503111a55 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.041491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.042185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.042471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.042752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.047405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.049420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.067784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 987/1947] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:48.071943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.082137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbf6fc-1c73-4797-90ed-eb2a1479ff90 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.089774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.089774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.090066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.090252 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] PATH_INFO: `/v3/projects/f6ee19874fe3485abd243ac92434b3b2/users/7af8193a0c754605ba188f19da1ed5f1/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.107237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ee19874fe3485abd243ac92434b3b2, user_id=7af8193a0c754605ba188f19da1ed5f1, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.109703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d2c03-3101-4f7e-969f-59bdb25ba859 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.146912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1878bada1624424190836f8ff13a57a3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:48.180917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 988/1948] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:48 2022] PUT /identity/v3/projects/f6ee19874fe3485abd243ac92434b3b2/users/7af8193a0c754605ba188f19da1ed5f1/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:48.191155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.192042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.192337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.231826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1878bada1624424190836f8ff13a57a3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:48.233012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1878bada1624424190836f8ff13a57a3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:48.260439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1878bada1624424190836f8ff13a57a3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:48.279415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] MFA Rules not processed for user `7af8193a0c754605ba188f19da1ed5f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:48.279625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d409981c-18c2-442e-80e3-a857b50db5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1878bada1624424190836f8ff13a57a3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:48.280766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:48.291476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 961/1949] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:47 2022] DELETE /identity/v3/users/1878bada1624424190836f8ff13a57a3 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:48.304203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.304944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.305316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.329103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:48.330575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:48.414551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 989/1950] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:48.420517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.424209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:48.429082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 962/1951] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:48.460401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:48.480294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.483488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:48.553823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10991095-7e6a-48c2-bc96-de03dacd105f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.563939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:48.566561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.568066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.568506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.568951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.570686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee5f91-20ac-454f-a714-5482b3fa6ec7 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.571130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.574181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.575192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.576061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.576529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.576957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.602586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.604121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.617680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 963/1952] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:48.694300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 990/1953] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:48 2022] POST /identity/v3/projects => generated 385 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:48.698236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.712869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca529370-eb1f-4c0b-9c6c-c6f4a15cb756 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.789323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.790128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.790409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.790680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.791703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.793671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.877467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 964/1954] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:48 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:48.882339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:48.910456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85875a4-11d7-4721-b4d8-200a23b39509 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:48.935641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:48.936436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:48.936723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:48.937071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:48.937802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:48.943223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:48.985579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 991/1955] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:48.987755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.003164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c181e9b-88a6-4519-871f-9f3027f1ec7b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.012490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.016551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.016551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.016551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] PATH_INFO: `/v3/projects/5b0a831084234c5483887f16fd69bf81/users/fe5e49bf1d35415da5db55fcacbf9f86/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.045135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0a831084234c5483887f16fd69bf81, user_id=fe5e49bf1d35415da5db55fcacbf9f86, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.047954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.112437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 965/1956] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:48 2022] PUT /identity/v3/projects/5b0a831084234c5483887f16fd69bf81/users/fe5e49bf1d35415da5db55fcacbf9f86/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:49.116423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.127382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced40d4-9da0-4a11-909a-be7be17d7aea admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.187571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.188261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.188568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.188848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.189623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.191243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.201715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 992/1957] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:49.205877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.217936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b0759b-4272-47f0-b9a9-715334f3ccd7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.224236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.225186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.225471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.225777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] PATH_INFO: `/v3/projects/5b0a831084234c5483887f16fd69bf81/users/fe5e49bf1d35415da5db55fcacbf9f86/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.227770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0a831084234c5483887f16fd69bf81, user_id=fe5e49bf1d35415da5db55fcacbf9f86, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.240736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.243302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:49.245235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf2306-2fda-4a56-a5c5-129ed7b8ecbd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.274036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d6590-4280-4d80-89ee-517d076a6ca9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.289618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.290693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.291346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.291994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] PATH_INFO: `/v3/projects/b85d9fabbbf9463e80037ec778472d03` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.293725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85d9fabbbf9463e80037ec778472d03)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.296182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.304623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 966/1958] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:49 2022] PUT /identity/v3/projects/5b0a831084234c5483887f16fd69bf81/users/fe5e49bf1d35415da5db55fcacbf9f86/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:49.321209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.325150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.325150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.377980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] MFA Rules not processed for user `fe5e49bf1d35415da5db55fcacbf9f86`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:49.380463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:49.403292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:49.456016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85d9fabbbf9463e80037ec778472d03', 'request_id': 'req-4a1aa7fa-bca2-486e-a2cc-f494296766cc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:49.490617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 967/1959] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:49.508835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.510432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:49.563496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85d9fabbbf9463e80037ec778472d03', 'request_id': 'req-4a1aa7fa-bca2-486e-a2cc-f494296766cc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:49.574919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85d9fabbbf9463e80037ec778472d03', 'request_id': 'req-4a1aa7fa-bca2-486e-a2cc-f494296766cc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:49.591996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] The token cache is being invalidate because project b85d9fabbbf9463e80037ec778472d03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:49.592570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:49.593444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:49.595572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 993/1960] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:49 2022] DELETE /identity/v3/projects/b85d9fabbbf9463e80037ec778472d03 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:49.599900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:49.601414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:49.604550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12605ac7-233a-4309-89c2-87c73ff98a0c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.686766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.688192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.688632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.689337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.692606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:49.718638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1aa7fa-bca2-486e-a2cc-f494296766cc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:49.725732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:49.726776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:49.727213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:49.727471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] PATH_INFO: `/v3/users/5d20d543ba3a4cf088267b46a4d7c279` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:49.728832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d20d543ba3a4cf088267b46a4d7c279)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.730894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.850375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:49.871138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:49.872646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:49.885227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 968/1961] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:49.960042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d20d543ba3a4cf088267b46a4d7c279'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:50.027323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d20d543ba3a4cf088267b46a4d7c279'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:50.047809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d20d543ba3a4cf088267b46a4d7c279'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:50.047809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d20d543ba3a4cf088267b46a4d7c279'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:50.056324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d20d543ba3a4cf088267b46a4d7c279'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:50.080606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 994/1962] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:49 2022] DELETE /identity/v3/users/5d20d543ba3a4cf088267b46a4d7c279 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:50.529039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:50.837431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:51.251431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:51.253477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:51.264524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1168ec4d-2acc-4a40-8685-ad3e30ceb32b service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:51.319053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:51.319726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:51.320014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:51.320291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:51.322350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:51.383840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:51.385477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdaa73a-d046-4ce9-bdf0-c9592a5e0998 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:51.395792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 969/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:51.542347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:51.543997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:51.653288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150c89-2c02-4bb4-9f78-81fee56f6031 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:51.658525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:51.659530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:51.660032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:51.661185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] PATH_INFO: `/v3/projects/ff203f14ac0b47c4b27dbb9854112b29` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:51.662948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff203f14ac0b47c4b27dbb9854112b29)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:51.666753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:51.820813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff203f14ac0b47c4b27dbb9854112b29', 'request_id': 'req-848310a0-9331-4488-bd1b-6ceb6d9e2507'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:51.894240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff203f14ac0b47c4b27dbb9854112b29', 'request_id': 'req-848310a0-9331-4488-bd1b-6ceb6d9e2507'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:51.903116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff203f14ac0b47c4b27dbb9854112b29', 'request_id': 'req-848310a0-9331-4488-bd1b-6ceb6d9e2507'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:51.938322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] The token cache is being invalidate because project ff203f14ac0b47c4b27dbb9854112b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:51.938764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:51.939522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-848310a0-9331-4488-bd1b-6ceb6d9e2507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:51.945176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 995/1964] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:51 2022] DELETE /identity/v3/projects/ff203f14ac0b47c4b27dbb9854112b29 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:51.946644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:51.946946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:51.947233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:51.987114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:51.988601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:52.153915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 970/1965] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:52.162389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.162782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.163159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.213202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:52.215958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:52.244386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 996/1966] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:52.248504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.262922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f4a4e-bba8-4dc3-a73a-aa879b0bff6a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.275831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.276683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.277095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.277580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.278534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:52.279036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.280927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.325456 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 971/1967] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:52.333100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.345725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ec5d1-452d-443f-89d8-b4aafd727251 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.362976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.362976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.363291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.363657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.371587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.377333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.499733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:52.513310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 997/1968] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:52 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:52.514571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.530102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b061c24-987a-4874-9db2-6c37f60fa319 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.633107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.633967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.634373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.634666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.635600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.637774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.713751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 972/1969] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:52 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:52.717587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.728761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd22d3-db3b-4ccf-b79a-169d9369c5a4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.734153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.735001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.735294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.735569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.736449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.738096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.749500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 998/1970] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:26:52.753703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.767392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f9d6d-420a-435b-9465-9ed5f7ab01a5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.775377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.776429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.777251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.777594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.778524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.780210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501104b6-2108-4195-82cf-4ba35e40a47a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.795026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 973/1971] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:26:52.800571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:52.812767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4737a8d6-292d-4c07-afe7-40fb13093272 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:52.818222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:52.819497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.820054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.823457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] PATH_INFO: `/v3/projects/6ced3bf77d5f43cd9ef282c106432eb6/users/58b8701da6944830856399a8addb2183/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.844506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ced3bf77d5f43cd9ef282c106432eb6, user_id=58b8701da6944830856399a8addb2183, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:52.849241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:52.948024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 999/1972] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:52 2022] PUT /identity/v3/projects/6ced3bf77d5f43cd9ef282c106432eb6/users/58b8701da6944830856399a8addb2183/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:52.959637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:52.959930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:52.960369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:52.994733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] MFA Rules not processed for user `58b8701da6944830856399a8addb2183`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:52.994733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:53.067390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 974/1973] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:53.068899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.077991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:53.156177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e193144-4c7b-47f6-982b-4cf1eff813a6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.162617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.163427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.163816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.164169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.165168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.167275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:53.220737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:53.278303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1000/1974] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:53 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:53.280076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.296644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3bdcc-04ca-491e-89ea-2c6e784b43de None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.436820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.449701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.450409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.451749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.452647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.458146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:53.572141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 975/1975] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:53 2022] POST /identity/v3/users => generated 298 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:53.575984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.587969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea9051-38a1-441e-8afb-99e9461427e2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.593114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.594131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.594131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.594340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.595458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.597044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:53.610740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1001/1976] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:53.615348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.626609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8bce-90a3-4987-b705-5cd62169682a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.633945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.638714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.638714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.638714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] PATH_INFO: `/v3/projects/62f0cf6da177419a85b22fb08247d78d/users/37165c3448f94485b5c5e86725c4e1a4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.660724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:53.666298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0cf6da177419a85b22fb08247d78d, user_id=37165c3448f94485b5c5e86725c4e1a4, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.673244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:53.808628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 976/1977] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:53 2022] PUT /identity/v3/projects/62f0cf6da177419a85b22fb08247d78d/users/37165c3448f94485b5c5e86725c4e1a4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:53.812758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.840762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b26fd24-ada0-41b8-b9b7-23ca32c1d2cd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.923865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.925221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.926715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.927150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.928219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.930040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c348d37-4c22-49c7-a5b7-1766b32a9dfb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:53.946334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1002/1978] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:53.955629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:53.971579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20afcecc-8f7a-4238-a8b2-d0b53aebe9c5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:53.978686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:53.979849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:53.980202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:53.980574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] PATH_INFO: `/v3/projects/62f0cf6da177419a85b22fb08247d78d/users/37165c3448f94485b5c5e86725c4e1a4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:53.982795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0cf6da177419a85b22fb08247d78d, user_id=37165c3448f94485b5c5e86725c4e1a4, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:53.985882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:54.001291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 977/1979] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:53 2022] PUT /identity/v3/projects/62f0cf6da177419a85b22fb08247d78d/users/37165c3448f94485b5c5e86725c4e1a4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:54.013613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:54.014131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:54.014570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:54.048863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] MFA Rules not processed for user `37165c3448f94485b5c5e86725c4e1a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:54.050647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:54.170712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1003/1980] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:54.185399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:54.187388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:54.270743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3a8334-4efa-4d60-9fde-e7076878413b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:54.276150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:54.277307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:54.277776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:54.278235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:54.288303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:54.355085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:54.357440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efc03d-a010-4a16-8bd4-99f2ad961aa2 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:54.370988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 978/1981] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:26:54.494657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:56.015671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:56.017156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:56.085010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8301ce2-3c4d-4531-8bef-da2d0a038f3d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:56.089832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:56.090717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:56.090998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:56.091276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] PATH_INFO: `/v3/users/efe0354df6f24e878d07fcbf120ccefc` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:56.092475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] RBAC: Authorizing `identity:delete_user(user_id=efe0354df6f24e878d07fcbf120ccefc)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:56.094456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:56.253032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efe0354df6f24e878d07fcbf120ccefc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:56.306619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efe0354df6f24e878d07fcbf120ccefc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:56.322150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efe0354df6f24e878d07fcbf120ccefc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:56.323191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efe0354df6f24e878d07fcbf120ccefc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:56.331219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efe0354df6f24e878d07fcbf120ccefc'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:56.340472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1004/1982] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:56 2022] DELETE /identity/v3/users/efe0354df6f24e878d07fcbf120ccefc => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:56.344834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547aa57-e234-4c72-872f-760565f6197d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:56.345708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547aa57-e234-4c72-872f-760565f6197d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:56.345993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547aa57-e234-4c72-872f-760565f6197d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:56.365460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d547aa57-e234-4c72-872f-760565f6197d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:56.367144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d547aa57-e234-4c72-872f-760565f6197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:56.458066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 979/1983] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:56.468475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:56.475773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:56.563755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c02052b-6c3d-426d-9ca8-1fca3557eeae admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:56.569004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:56.569922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:56.570210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:56.570822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:56.581743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:56.584184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:56.596337 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1005/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:57.267143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547aa57-e234-4c72-872f-760565f6197d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:57.268559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d547aa57-e234-4c72-872f-760565f6197d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:57.280979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547aa57-e234-4c72-872f-760565f6197d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:57.286526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:57.287862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:57.288150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:57.288428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] PATH_INFO: `/v3/projects/40410030cf1a4a6799ca6d4a92927458` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:57.289690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40410030cf1a4a6799ca6d4a92927458)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:57.291621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:57.385900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40410030cf1a4a6799ca6d4a92927458', 'request_id': 'req-58545cea-9719-48f9-8137-83b556c64f9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.454031 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40410030cf1a4a6799ca6d4a92927458', 'request_id': 'req-58545cea-9719-48f9-8137-83b556c64f9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.461127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40410030cf1a4a6799ca6d4a92927458', 'request_id': 'req-58545cea-9719-48f9-8137-83b556c64f9f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.472689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] The token cache is being invalidate because project 40410030cf1a4a6799ca6d4a92927458 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:57.473630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.474266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.475863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 980/1985] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:57 2022] DELETE /identity/v3/projects/40410030cf1a4a6799ca6d4a92927458 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:57.479909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:57.490155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3618944d-a9d4-4e68-b27c-ab5583ad80ce service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:57.506930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:57.548613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:57.549523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:57.549819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:57.550090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] PATH_INFO: `/v3/users/0feec536a744410582186e19599c3147` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:57.551404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0feec536a744410582186e19599c3147)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:57.553355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:57.783030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0feec536a744410582186e19599c3147'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.831616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0feec536a744410582186e19599c3147'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.848474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0feec536a744410582186e19599c3147'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.849226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0feec536a744410582186e19599c3147'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.860119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0feec536a744410582186e19599c3147'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:57.866732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1006/1986] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:26:57 2022] DELETE /identity/v3/users/0feec536a744410582186e19599c3147 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:58.157351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:58.158863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:58.207279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:58.223124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58545cea-9719-48f9-8137-83b556c64f9f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:58.274916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:58.275575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.275860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.276137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.278022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:58.324882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:58.326744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:58.347341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:58.350334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc0e12-88a9-454c-87b6-2939bf3fe6a7 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:58.369636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 981/1987] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:26:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:26:58.406369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017205a4-d1fe-4553-ad54-ee280e9eb287 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:58.414308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:58.415140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.415428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] PATH_INFO: `/v3/projects/23a774dd8f6c4cd79da444611ee1d228` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a774dd8f6c4cd79da444611ee1d228)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:58.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:58.546837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:58.554371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a774dd8f6c4cd79da444611ee1d228', 'request_id': 'req-9bf7bb64-ad8e-437c-8650-11069e7d2182'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:58.641833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a774dd8f6c4cd79da444611ee1d228', 'request_id': 'req-9bf7bb64-ad8e-437c-8650-11069e7d2182'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:58.648959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a774dd8f6c4cd79da444611ee1d228', 'request_id': 'req-9bf7bb64-ad8e-437c-8650-11069e7d2182'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:58.661407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] The token cache is being invalidate because project 23a774dd8f6c4cd79da444611ee1d228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:26:58.661763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:58.662485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bf7bb64-ad8e-437c-8650-11069e7d2182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:26:58.664122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1007/1988] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:26:58 2022] DELETE /identity/v3/projects/23a774dd8f6c4cd79da444611ee1d228 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:26:58.669073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.669537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.669742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.687331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:58.688535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:58.756800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 982/1989] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:58.765794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.766080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.766363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.785997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:58.787187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:58.795189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1008/1990] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:26:58.799668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:58.810359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9c85e-991a-4ed8-8420-04c7537a595f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:58.815867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:58.815867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.815867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.816152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.817207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:26:58.817518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:58.819126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:58.831410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 983/1991] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:26:58.836708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:58.846124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c18cb-f8a4-47a1-a918-99010abca17c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:58.851814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:58.852484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:58.852752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:58.853054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:58.853748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:58.855652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:58.931492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1009/1992] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:58 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:58.935584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:58.945523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac66f-775f-4939-9894-9734c8fd089a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:58.997098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:26:59.022889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.023968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.024196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.024462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.025166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.027073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.163502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 984/1993] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:58 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:59.164654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.174774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38926f5a-adc4-4f2e-be54-e35e3ae9a991 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.179465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.180121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.180428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.180709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.181470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.183070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.193882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1010/1994] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:59.197867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.209312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4f305-0c58-4103-b309-89e6deb29393 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.215084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.215749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.216060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.216454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.217116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.218703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424320bd-e4f5-4ff7-9230-150adb566f4b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.229570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 985/1995] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:59.233920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.245833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1b8457-d537-4174-80ef-2d97eb43fa3b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.250710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.251629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.251916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.252342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] PATH_INFO: `/v3/projects/583652be97b647afad60a0acbcd6c198/users/cb29bc1db6e3435cafff29ebc3430d5f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.274078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=583652be97b647afad60a0acbcd6c198, user_id=cb29bc1db6e3435cafff29ebc3430d5f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.278499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.365795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1011/1996] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:59 2022] PUT /identity/v3/projects/583652be97b647afad60a0acbcd6c198/users/cb29bc1db6e3435cafff29ebc3430d5f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:26:59.376847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.377168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.378333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.408660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] MFA Rules not processed for user `cb29bc1db6e3435cafff29ebc3430d5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:26:59.410136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:26:59.482212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 986/1997] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:26:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:26:59.488770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.572441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ba6e8-678d-4c1b-a0eb-99a365dde617 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.578144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.578812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.579114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.579369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.580113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.582260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.689400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1012/1998] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:26:59 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:26:59.690583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.702516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423720e-7f99-4786-ac35-f4b5572edc81 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.764930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.765683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.765978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.766255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.766969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.768980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.860741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 987/1999] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:26:59 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:26:59.866396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.878678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d6c62-98f2-46ee-b454-99e56d6973bb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.886023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.886705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.886993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.887353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.888150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.889866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:26:59.905322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1013/2000] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:26:59.906360 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:26:59.918188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eed6-297c-4a92-ace2-c69f0daf4e1b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:26:59.922796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:26:59.928710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:26:59.928710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:26:59.928710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] PATH_INFO: `/v3/projects/875af527c5ac45cf9a0594550e528c37/users/699ef287399f4092b5f3cb7bf816171f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:26:59.943953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] RBAC: Authorizing `identity:create_grant(project_id=875af527c5ac45cf9a0594550e528c37, user_id=699ef287399f4092b5f3cb7bf816171f, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:26:59.946643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:00.047432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 988/2001] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:26:59 2022] PUT /identity/v3/projects/875af527c5ac45cf9a0594550e528c37/users/699ef287399f4092b5f3cb7bf816171f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:00.051164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:00.064037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b584157-dad0-48d5-b1a3-3f4922a90ae5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:00.120729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:00.143668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:00.144668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:00.144948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:00.145305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:00.145988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:00.147606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f377c-7743-469b-a610-07849dccf906 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:00.157509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1014/2002] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:00.161782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:00.172282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43eee0-232f-4c58-b966-1e7f35e2d30f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:00.177478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:00.178363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:00.178651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:00.178988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] PATH_INFO: `/v3/projects/875af527c5ac45cf9a0594550e528c37/users/699ef287399f4092b5f3cb7bf816171f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:00.180947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=875af527c5ac45cf9a0594550e528c37, user_id=699ef287399f4092b5f3cb7bf816171f, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:00.185322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:00.187138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:00.195694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 989/2003] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:00 2022] PUT /identity/v3/projects/875af527c5ac45cf9a0594550e528c37/users/699ef287399f4092b5f3cb7bf816171f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:00.205918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:00.206231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:00.206597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:00.239860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] MFA Rules not processed for user `699ef287399f4092b5f3cb7bf816171f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:00.241086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:00.308827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1015/2004] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:00.320905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:00.322680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:00.382294 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a7418-5c01-4ad2-9f7f-f2b1a62ec9ce admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:00.385972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:00.386643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:00.386928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:00.387211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:00.396442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:00.397907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:00.407458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 990/2005] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:00.559075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:00.568784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf78fc-0be1-42cc-a114-997c38b9846b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:00.572510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:00.573180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:00.573466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:00.573748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:00.631558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:00.633005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90093600-41ec-4546-99ec-8d7f488a3cc6 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:00.641949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1016/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:01.097066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:01.172556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0fa84-cadf-4c13-a4f9-da25b8f2dc91 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:01.177058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:01.177949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:01.178277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:01.178544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] PATH_INFO: `/v3/users/cb29bc1db6e3435cafff29ebc3430d5f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:01.179752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb29bc1db6e3435cafff29ebc3430d5f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:01.181735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:01.362641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb29bc1db6e3435cafff29ebc3430d5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:01.414023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb29bc1db6e3435cafff29ebc3430d5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:01.414759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb29bc1db6e3435cafff29ebc3430d5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:01.429857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb29bc1db6e3435cafff29ebc3430d5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:01.437040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb29bc1db6e3435cafff29ebc3430d5f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:01.443191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 991/2007] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:01 2022] DELETE /identity/v3/users/cb29bc1db6e3435cafff29ebc3430d5f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:01.447813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:01.448106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:01.448386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:01.466013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:01.467239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:01.522961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=100 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:01.531111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1017/2008] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:01.541497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:01.546643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:01.565337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:01.602593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781be078-0d5d-4fde-83ba-711078c023a6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:01.606362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:01.606960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:01.607243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:01.607515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:01.617277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:01.618767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:01.627971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 992/2009] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:02.032493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:02.033877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.047544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3e444-de5d-4a3e-a43a-4d4482e05ad3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:02.060350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:02.061554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.062574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.063211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] PATH_INFO: `/v3/projects/583652be97b647afad60a0acbcd6c198` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:02.064777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=583652be97b647afad60a0acbcd6c198)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:02.067551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:02.188897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583652be97b647afad60a0acbcd6c198', 'request_id': 'req-8dffc177-76c0-467c-927a-57d511c137d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.229978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:02.231461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.259735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583652be97b647afad60a0acbcd6c198', 'request_id': 'req-8dffc177-76c0-467c-927a-57d511c137d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.266775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583652be97b647afad60a0acbcd6c198', 'request_id': 'req-8dffc177-76c0-467c-927a-57d511c137d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.279234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] The token cache is being invalidate because project 583652be97b647afad60a0acbcd6c198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:02.279515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.280184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.282050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1018/2010] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:02 2022] DELETE /identity/v3/projects/583652be97b647afad60a0acbcd6c198 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:02.286611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:02.288087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.299761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a80b0-01be-4836-9ebb-21e0c96e0505 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:02.355783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:02.356439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.356724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.357001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:02.361525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.363582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffc177-76c0-467c-927a-57d511c137d2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:02.368944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:02.370008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.370558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.370669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] PATH_INFO: `/v3/users/699ef287399f4092b5f3cb7bf816171f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:02.371972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] RBAC: Authorizing `identity:delete_user(user_id=699ef287399f4092b5f3cb7bf816171f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:02.373938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:02.439005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:02.440453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:02.455995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 993/2011] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:02.484981 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:02.489558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.510208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a20248-c0d3-4156-84f1-d16cd978e790 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:02.516684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:02.517735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.518030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.518313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] PATH_INFO: `/v3/users/737c6ed303454738a92b449f77986d1c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:02.519707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=737c6ed303454738a92b449f77986d1c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:02.522085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:02.553878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:02.585853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '699ef287399f4092b5f3cb7bf816171f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.642822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '699ef287399f4092b5f3cb7bf816171f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.662043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '699ef287399f4092b5f3cb7bf816171f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.662819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '699ef287399f4092b5f3cb7bf816171f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.669879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-145a93c9-6f67-403c-bca0-b28924c8623a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '699ef287399f4092b5f3cb7bf816171f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.676724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1019/2012] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:02 2022] DELETE /identity/v3/users/699ef287399f4092b5f3cb7bf816171f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:02.698142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737c6ed303454738a92b449f77986d1c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.750369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737c6ed303454738a92b449f77986d1c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.751209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737c6ed303454738a92b449f77986d1c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.766973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737c6ed303454738a92b449f77986d1c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.776786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737c6ed303454738a92b449f77986d1c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:02.784021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 994/2013] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:02 2022] DELETE /identity/v3/users/737c6ed303454738a92b449f77986d1c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:02.789455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.789745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.790061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:02.796063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:02.809922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:02.811134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.883502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1020/2014] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:02.917299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:02.917299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:02.991565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99194dcd-f791-4406-8bdc-1df0232c98eb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:02.991959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:02.992897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:02.992897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:02.993227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.003129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.004895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708bdb4-028a-443e-845e-187ec5b80b48 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.016040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 995/2015] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:03.272381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.274172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:03.287879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b5acb-40e6-4eec-a1d2-a8782f42c1f0 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:03.293895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:03.294843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.295127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.295521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] PATH_INFO: `/v3/projects/875af527c5ac45cf9a0594550e528c37` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.296778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=875af527c5ac45cf9a0594550e528c37)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.299327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.433565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875af527c5ac45cf9a0594550e528c37', 'request_id': 'req-95c66367-97bf-47c0-8718-afc1311c04eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.517978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875af527c5ac45cf9a0594550e528c37', 'request_id': 'req-95c66367-97bf-47c0-8718-afc1311c04eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.526806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875af527c5ac45cf9a0594550e528c37', 'request_id': 'req-95c66367-97bf-47c0-8718-afc1311c04eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.542063 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] The token cache is being invalidate because project 875af527c5ac45cf9a0594550e528c37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:03.542405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.543069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.544792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1021/2016] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:03 2022] DELETE /identity/v3/projects/875af527c5ac45cf9a0594550e528c37 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:03.550069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76234e3-042e-45c3-a829-0d9d4a31487a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.551285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76234e3-042e-45c3-a829-0d9d4a31487a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.551778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76234e3-042e-45c3-a829-0d9d4a31487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.570878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b76234e3-042e-45c3-a829-0d9d4a31487a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:03.572135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b76234e3-042e-45c3-a829-0d9d4a31487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:03.615188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.616642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:03.640743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 996/2017] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:03.649963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.650256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.650544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.669628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:03.670833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:03.679305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 997/2018] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:03.683507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.687781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c66367-97bf-47c0-8718-afc1311c04eb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:03.693301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c098f-a213-4baf-be12-8d0197e5e058 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:03.693520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:03.694395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.694683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.694965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] PATH_INFO: `/v3/projects/8de84988456a41c7aa1504a95c764c8b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.696157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de84988456a41c7aa1504a95c764c8b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.698165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:03.698297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.698793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.699191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.699593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.700196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:03.700507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.702211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.719631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 998/2019] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:03.720662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.730746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82673a64-8428-4082-97ce-4a696310e28a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:03.735511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:03.736177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.736504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.736732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.737479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.739441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.793752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:03.809737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de84988456a41c7aa1504a95c764c8b', 'request_id': 'req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.849654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:03.856388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 999/2020] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:03 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:03.860279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.878531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de84988456a41c7aa1504a95c764c8b', 'request_id': 'req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.886333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de84988456a41c7aa1504a95c764c8b', 'request_id': 'req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.897919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] The token cache is being invalidate because project 8de84988456a41c7aa1504a95c764c8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:03.898406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.899081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:03.901575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1022/2021] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:03 2022] DELETE /identity/v3/projects/8de84988456a41c7aa1504a95c764c8b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:03.905463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:03.907176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:03.930280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09167e-88df-47ef-85ff-2e29aaa77f4b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:03.936326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:03.937035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:03.937341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:03.937621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:03.938364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:03.941368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:03.998398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a6c9b-c3af-4dd9-9383-4a2fbab4554d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.005850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.007167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.007637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.008089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] PATH_INFO: `/v3/users/7af8193a0c754605ba188f19da1ed5f1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.009638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7af8193a0c754605ba188f19da1ed5f1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.011992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:04.092134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1000/2022] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:03 2022] POST /identity/v3/users => generated 292 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:04.096577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.100197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:04.113749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4cebe-49a6-4d38-904f-9aa4bd0d5cef admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.119087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.119906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.120194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.123023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.123023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.123023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:04.137386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1001/2023] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:27:04.138881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.149950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20bc291-6878-480c-9e07-44ce9207b801 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.155274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.155618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.155902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.163446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.163446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.163446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:04.180862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1002/2024] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:04.189489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.200681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ad60e-21f0-4dfb-8833-5b6a559e4825 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.207336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.208334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.208666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.208947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] PATH_INFO: `/v3/projects/e4b1898881414d0ebd8927b2f6031d21/users/448d204726f04dc6b15f6257de0493d6/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.225206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b1898881414d0ebd8927b2f6031d21, user_id=448d204726f04dc6b15f6257de0493d6, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.228043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62add7-5595-4510-ad7c-8f67d0a6ab2d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:04.247599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7af8193a0c754605ba188f19da1ed5f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:04.320156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1003/2025] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:04 2022] PUT /identity/v3/projects/e4b1898881414d0ebd8927b2f6031d21/users/448d204726f04dc6b15f6257de0493d6/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:04.330685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.331000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.331277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.334651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7af8193a0c754605ba188f19da1ed5f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:04.348378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7af8193a0c754605ba188f19da1ed5f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:04.349092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7af8193a0c754605ba188f19da1ed5f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:04.356599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7af8193a0c754605ba188f19da1ed5f1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:04.358417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] MFA Rules not processed for user `448d204726f04dc6b15f6257de0493d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:04.359687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:04.362995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1023/2026] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:03 2022] DELETE /identity/v3/users/7af8193a0c754605ba188f19da1ed5f1 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:04.446676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1004/2027] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:04.786673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.788121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:04.834669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:04.835583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.838788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:04.855704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0d1d7e-5fa9-412e-92a6-1fedec0de9f1 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.859884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.867595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.867595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.867980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.886544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:04.921157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982a17-3f17-4f8a-b079-ef8e83d733af None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:04.948858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.952237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:04.964662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1024/2028] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:04.989453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:04.992326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:04.992962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:04.994015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:04.994372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:04.994784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] PATH_INFO: `/v3/projects/f6ee19874fe3485abd243ac92434b3b2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:04.996613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ee19874fe3485abd243ac92434b3b2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:04.998827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:05.012706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee4fd9-efd2-48ef-9a72-7d1c917a2e0e service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:05.020578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:05.022422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:05.023283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:05.024075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] PATH_INFO: `/v3/users/448d204726f04dc6b15f6257de0493d6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:05.026093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] RBAC: Authorizing `identity:delete_user(user_id=448d204726f04dc6b15f6257de0493d6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:05.028532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:05.127380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ee19874fe3485abd243ac92434b3b2', 'request_id': 'req-fbcdf985-0246-4166-ae8b-f91e92a6f414'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.213325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ee19874fe3485abd243ac92434b3b2', 'request_id': 'req-fbcdf985-0246-4166-ae8b-f91e92a6f414'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.219353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ee19874fe3485abd243ac92434b3b2', 'request_id': 'req-fbcdf985-0246-4166-ae8b-f91e92a6f414'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.226661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448d204726f04dc6b15f6257de0493d6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.230415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] The token cache is being invalidate because project f6ee19874fe3485abd243ac92434b3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:05.230706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.231350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.232927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1005/2029] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:04 2022] DELETE /identity/v3/projects/f6ee19874fe3485abd243ac92434b3b2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:05.237015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:05.240058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:05.282796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448d204726f04dc6b15f6257de0493d6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.295758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448d204726f04dc6b15f6257de0493d6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.296430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448d204726f04dc6b15f6257de0493d6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.303159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdf985-0246-4166-ae8b-f91e92a6f414 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:05.303825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-40911be6-c2ed-4fc4-8049-b5143055264e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448d204726f04dc6b15f6257de0493d6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.307831 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:05.308716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:05.309013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:05.309326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] PATH_INFO: `/v3/users/fe5e49bf1d35415da5db55fcacbf9f86` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:05.309834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1025/2030] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:04 2022] DELETE /identity/v3/users/448d204726f04dc6b15f6257de0493d6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:05.310718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5e49bf1d35415da5db55fcacbf9f86)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:05.312652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:05.314280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:05.314570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:05.314853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:05.336802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:05.338079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:05.396909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1026/2031] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:05.406597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:05.407944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:05.466997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd0523-1acf-4b47-91ff-6431841fbb77 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:05.470868 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:05.471551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:05.471837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:05.472133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:05.482389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:05.483830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:05.494474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1027/2032] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:05.541896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:05.556464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5e49bf1d35415da5db55fcacbf9f86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.591091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:05.642263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5e49bf1d35415da5db55fcacbf9f86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.642938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5e49bf1d35415da5db55fcacbf9f86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.656363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5e49bf1d35415da5db55fcacbf9f86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.663645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5e49bf1d35415da5db55fcacbf9f86'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:05.669670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1006/2033] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:05 2022] DELETE /identity/v3/users/fe5e49bf1d35415da5db55fcacbf9f86 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:05.961512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:05.963213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:05.975990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c838faf-ff5c-46f8-b0e2-e2e5ae0056e2 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.051317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.051885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.052171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.052465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] PATH_INFO: `/v3/projects/e4b1898881414d0ebd8927b2f6031d21` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.054289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b1898881414d0ebd8927b2f6031d21)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.058031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.154347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.155997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.169817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22269b32-18db-40a8-9d6d-f83e0ab24d46 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.175113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.176726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.177007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.177596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] PATH_INFO: `/v3/projects/5b0a831084234c5483887f16fd69bf81` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.178826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0a831084234c5483887f16fd69bf81)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.180877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.231529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b1898881414d0ebd8927b2f6031d21', 'request_id': 'req-aecd5757-40f6-45bc-8a37-70765d3511ed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.313118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0a831084234c5483887f16fd69bf81', 'request_id': 'req-f8fce772-e458-4e3a-be93-07467e46d1db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.341502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b1898881414d0ebd8927b2f6031d21', 'request_id': 'req-aecd5757-40f6-45bc-8a37-70765d3511ed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.349609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b1898881414d0ebd8927b2f6031d21', 'request_id': 'req-aecd5757-40f6-45bc-8a37-70765d3511ed'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.362243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] The token cache is being invalidate because project e4b1898881414d0ebd8927b2f6031d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:06.362536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.363783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-aecd5757-40f6-45bc-8a37-70765d3511ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.365828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1028/2034] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:05 2022] DELETE /identity/v3/projects/e4b1898881414d0ebd8927b2f6031d21 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:06.370413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b509-af0f-4f84-95bf-090916c64272 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.370706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b509-af0f-4f84-95bf-090916c64272 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.370985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e857b509-af0f-4f84-95bf-090916c64272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.390453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e857b509-af0f-4f84-95bf-090916c64272 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:06.391666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e857b509-af0f-4f84-95bf-090916c64272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.421862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:06.452265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1029/2035] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:06.460115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.460408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.460692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.471110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0a831084234c5483887f16fd69bf81', 'request_id': 'req-f8fce772-e458-4e3a-be93-07467e46d1db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.477214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0a831084234c5483887f16fd69bf81', 'request_id': 'req-f8fce772-e458-4e3a-be93-07467e46d1db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.479030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:06.480393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.489388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1030/2036] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:06.490070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] The token cache is being invalidate because project 5b0a831084234c5483887f16fd69bf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:06.490364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.491009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f8fce772-e458-4e3a-be93-07467e46d1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:06.492998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1007/2037] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:06 2022] DELETE /identity/v3/projects/5b0a831084234c5483887f16fd69bf81 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:06.497319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.498623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ff7d-269c-46c6-befe-595d82cf2588 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.498915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ff7d-269c-46c6-befe-595d82cf2588 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.499247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532ff7d-269c-46c6-befe-595d82cf2588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.504327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0453e6b-93df-40d8-abfa-8359b8bf429a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.510194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.510906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.511193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.511491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.512220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:06.512545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.514607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.520064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7532ff7d-269c-46c6-befe-595d82cf2588 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:06.521341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7532ff7d-269c-46c6-befe-595d82cf2588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.530555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1031/2038] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:06.530714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1008/2039] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:06.531646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.533401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.538967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.539255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.539571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.547106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c55583-d6a0-40a8-8d1c-67a7fde90687 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.554745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.555627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.559578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.559578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.559578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.559578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.559878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:06.560088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.568546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1009/2040] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:06.572804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.581700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b335dc2-0639-4b54-b4d9-16e2c7f5cb8e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.586929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.587651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.587935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.588276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.589133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:06.589443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.591023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.603331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1010/2041] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:06.607579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.617972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a30dc-f57f-4806-abd1-4d776dd9a8aa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.622654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.623279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.623564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.623834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.624598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.626599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.638987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1032/2042] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:06.643150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.708267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501c12-65f1-4204-a533-5e40afbbae68 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.713395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.714066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.715428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.715428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.715428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.717491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.754109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1011/2043] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:06.758437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.789797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:06.805713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1033/2044] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/users => generated 281 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:06.808890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.812393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.840369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2255b-7b99-4475-8898-07132558bfb0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.845800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.846616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.846840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.847130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.848696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.850860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.880188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d286-a4ac-4ea7-b67f-bf0ea4305c6e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.919767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:06.928455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1012/2045] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:06 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:06.928455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.942113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.942113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.942113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.942113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.942408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:06.942491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cf22e-095e-4d3a-9da9-e88c0cecce6a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.944220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.946483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.946483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.946483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.948462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.950910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:06.964258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1013/2046] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:06.966243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:06.980292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4e4cb-5714-4f03-a024-dec6dc00d478 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:06.987351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:06.987351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:06.987351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:06.987351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:06.989839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:06.989839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.002902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1014/2047] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:07.003891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.018296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263f9d7-3f6f-4f7b-ad3c-3a881cb348ba admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.024872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.025626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.025993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.026705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.032286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.032286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.033711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.035956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.041060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1015/2048] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:07.041915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.047209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1034/2049] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:07.048039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.054721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c025-c8b7-4079-a287-f30e5ea6b2c0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.060435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.061539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.061829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.062104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.062843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.064852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.067489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3dfba1-959b-4f07-af02-294458c53c11 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.072327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.073279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.073560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.073844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] PATH_INFO: `/v3/projects/bb72dc2580114d9a9b45ece5de59551e/users/f793c8676ddd41ffb528877b8e29550f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.079894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1016/2050] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:07.084854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.092910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb72dc2580114d9a9b45ece5de59551e, user_id=f793c8676ddd41ffb528877b8e29550f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.095786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bfcb23-0bba-45a6-948b-5dded20a596c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.099658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efa02a7-dae7-4128-aef3-1bb9c5438b58 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.106307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.108054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.108054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.108054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] PATH_INFO: `/v3/projects/bba31ac669f64bb8be1c26d0dad7b4ac/users/ff6a0b84c11a4c0aa2683880c30dc6e2/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.123908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba31ac669f64bb8be1c26d0dad7b4ac, user_id=ff6a0b84c11a4c0aa2683880c30dc6e2, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.126731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4f62d-77f2-44e7-8d8f-0351aca8840c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.152290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1035/2051] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:07 2022] PUT /identity/v3/projects/bb72dc2580114d9a9b45ece5de59551e/users/f793c8676ddd41ffb528877b8e29550f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:07.164124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.164417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.164727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.199616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1017/2052] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:07 2022] PUT /identity/v3/projects/bba31ac669f64bb8be1c26d0dad7b4ac/users/ff6a0b84c11a4c0aa2683880c30dc6e2/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:07.200135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] MFA Rules not processed for user `f793c8676ddd41ffb528877b8e29550f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:07.201399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.201939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.202234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.202512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.234293 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] MFA Rules not processed for user `ff6a0b84c11a4c0aa2683880c30dc6e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:07.236058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.298932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1036/2053] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:07.331043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.332798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.335038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1018/2054] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:07.343943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.389374 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:07.397978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd08f-4c07-457e-b33e-4ee66790827e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.401975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.402631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.402913 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.403193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.414053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.415169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0a168d-e83a-45a0-b222-590249b234d4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.415666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.419648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:07.421592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.422273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.426960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.426960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.426960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.426960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.427455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1037/2055] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:07.442422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.454061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e654ae-a17f-49c0-a599-b7a4226f44b5 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.458965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.460003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.460160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.460435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] PATH_INFO: `/v3/users/f793c8676ddd41ffb528877b8e29550f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.461952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f793c8676ddd41ffb528877b8e29550f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.463884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.546644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1019/2056] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:07 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:07.550472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.611703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d98f-4361-4f4f-b973-775c5cce8b7c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.617683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.618404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.618687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.618961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.619650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.621616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.644049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f793c8676ddd41ffb528877b8e29550f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:07.699883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f793c8676ddd41ffb528877b8e29550f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:07.705666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1020/2057] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:07 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:07.711143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.715800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f793c8676ddd41ffb528877b8e29550f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:07.716777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f793c8676ddd41ffb528877b8e29550f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:07.723115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a58d2a-41c1-4be2-a70b-ea00cc12e31a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.724476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-971e0cad-4b10-4da0-affa-45282563b7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f793c8676ddd41ffb528877b8e29550f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:07.728405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.729124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.730101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.730101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.730663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.731462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1038/2058] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:07 2022] DELETE /identity/v3/users/f793c8676ddd41ffb528877b8e29550f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:07.734733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.736040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.736585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.736585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.756054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1021/2059] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:27:07.765165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:07.765165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.773408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.775685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.790476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051e2d2-a726-4ba0-83d3-417741765e35 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.833513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1039/2060] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:07.843361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:07.844977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:07.866946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.867969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.868248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.868920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] PATH_INFO: `/v3/projects/13a560fa7c7c462bb59bbeac2a51782f/users/92cc2f1728a8401bab686c304f4dd2e6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.886900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a560fa7c7c462bb59bbeac2a51782f, user_id=92cc2f1728a8401bab686c304f4dd2e6, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.890877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.911053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf747b-5a14-4a3d-b0e8-1f13521b9a48 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:07.915134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:07.915816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:07.916100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:07.916377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:07.925710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:07.927135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:07.936579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1040/2061] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:08.002518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1022/2062] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:07 2022] PUT /identity/v3/projects/13a560fa7c7c462bb59bbeac2a51782f/users/92cc2f1728a8401bab686c304f4dd2e6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:08.006781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:08.016759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446dc84-8efd-4cf7-9d58-aa4303109320 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:08.026966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:08.074895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:08.075653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.075936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.076213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.076941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:08.078657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197a2fe-5c4d-4349-98fe-be51edd607aa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:08.090497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1041/2063] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:08.100285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:08.112708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715085a-01ac-441d-aa31-cfc303b732e6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:08.121098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:08.122037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.122317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.122614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] PATH_INFO: `/v3/projects/13a560fa7c7c462bb59bbeac2a51782f/users/92cc2f1728a8401bab686c304f4dd2e6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.124824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a560fa7c7c462bb59bbeac2a51782f, user_id=92cc2f1728a8401bab686c304f4dd2e6, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:08.127886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:08.165247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1023/2064] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:08 2022] PUT /identity/v3/projects/13a560fa7c7c462bb59bbeac2a51782f/users/92cc2f1728a8401bab686c304f4dd2e6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:08.176603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.176892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.177333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.207497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] MFA Rules not processed for user `92cc2f1728a8401bab686c304f4dd2e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:08.208996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:08.285732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1042/2065] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:08.296895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:08.298727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:08.310097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:08.362214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fcb12-3702-4c17-938e-d756d997dee6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:08.366643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:08.367540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.367827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.368103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.380077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:08.380577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:08.382055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:08.382435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:08.399995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1024/2066] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:08.489366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a45612-2b44-4d4e-ae75-821de4da5499 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:08.494145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:08.495045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.495330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.495603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] PATH_INFO: `/v3/projects/bb72dc2580114d9a9b45ece5de59551e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.496806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb72dc2580114d9a9b45ece5de59551e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:08.498766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:08.717181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:08.726372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb72dc2580114d9a9b45ece5de59551e', 'request_id': 'req-142a28b4-2db1-44e6-bdd4-6321620ea2c1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:08.805056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:08.806793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:08.819229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb72dc2580114d9a9b45ece5de59551e', 'request_id': 'req-142a28b4-2db1-44e6-bdd4-6321620ea2c1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:08.827318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb72dc2580114d9a9b45ece5de59551e', 'request_id': 'req-142a28b4-2db1-44e6-bdd4-6321620ea2c1'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:08.827871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa2524-5bb5-40a2-a7ca-d6007ff7fe54 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:08.848299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] The token cache is being invalidate because project bb72dc2580114d9a9b45ece5de59551e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:08.848597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:08.853526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-142a28b4-2db1-44e6-bdd4-6321620ea2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:08.859600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1043/2067] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:08 2022] DELETE /identity/v3/projects/bb72dc2580114d9a9b45ece5de59551e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:08.861550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283968-edee-4524-9210-9362c05b000c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.861851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283968-edee-4524-9210-9362c05b000c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.862139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283968-edee-4524-9210-9362c05b000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.891125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f3283968-edee-4524-9210-9362c05b000c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:08.891125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f3283968-edee-4524-9210-9362c05b000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:08.924668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:08.927503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.931262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.931262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] PATH_INFO: `/v3/users/58b8701da6944830856399a8addb2183` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:08.935332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b8701da6944830856399a8addb2183)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:08.938737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:08.984731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1044/2068] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:08.996328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:08.996641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:08.996900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.017120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:09.020788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.028852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1045/2069] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:09.032981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.044089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02efa2b-a4ab-4861-988a-4390db3b0c8d None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.048890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.049588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.049876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.050180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.051417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:09.051738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.053415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.066800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1046/2070] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:09.072042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.083743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df31ad-b7cf-4b15-8299-2539d51150a3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.088910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.089609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.089939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.090185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.090875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.092890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.149246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b8701da6944830856399a8addb2183'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.168849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1047/2071] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:09 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:09.169814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.171436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.234812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55844c-00f6-4c16-8b50-233c37e4a0eb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.240049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.240928 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.241461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.241575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] PATH_INFO: `/v3/users/ff6a0b84c11a4c0aa2683880c30dc6e2` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.242708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff6a0b84c11a4c0aa2683880c30dc6e2)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.244626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.276826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b8701da6944830856399a8addb2183'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.281482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b8701da6944830856399a8addb2183'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.290750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b8701da6944830856399a8addb2183'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.298044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b8701da6944830856399a8addb2183'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.304927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1025/2072] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:08 2022] DELETE /identity/v3/users/58b8701da6944830856399a8addb2183 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:09.305811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.307128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.342664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:09.373555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7043bcc-15c2-43a3-a321-b4718a455f76 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.379576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.379576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.379816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.380016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.380706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.382673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bf66a-6fc9-4d17-a895-6777450216c9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.444799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff6a0b84c11a4c0aa2683880c30dc6e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.454409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:09.465331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1026/2073] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:09 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:09.465331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.465331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.465331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.483486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:09.488492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.492798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1027/2074] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:09.493768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.503309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de830-8df7-4917-89b8-09328b27ddb1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.505541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff6a0b84c11a4c0aa2683880c30dc6e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.510152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.510152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.510152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.510152 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.510500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.512081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.518478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff6a0b84c11a4c0aa2683880c30dc6e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.519132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff6a0b84c11a4c0aa2683880c30dc6e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.523091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1028/2075] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:09.527244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.527244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.527452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff6a0b84c11a4c0aa2683880c30dc6e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:09.533424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1048/2076] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:09 2022] DELETE /identity/v3/users/ff6a0b84c11a4c0aa2683880c30dc6e2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:09.536861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.536861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.597699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f8824-cfe2-4ff0-b7c3-c449213ad3e6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.618514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c6ada-e8e9-4519-a52a-6a9929ee1383 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.629875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.632073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.632375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.633727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.634496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.636242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804091d-573b-4450-8dd4-9b5f07f55728 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.649672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1049/2077] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:09.654446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.654771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.655022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.676930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.677862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.678353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.678703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.681523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.688018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:09.690122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.695523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.697059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.708998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1029/2078] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:09.709878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.710156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1050/2079] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:09.721252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c1b52-134c-47e2-939f-99a06cc4a353 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.727997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.727997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.728203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.728203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.728203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.728203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] PATH_INFO: `/v3/projects/7fc280705af54fcdad1e708ecdfff2d2/users/97540f5f152a4a8d9c4d36afac2baafa/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.749998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc280705af54fcdad1e708ecdfff2d2, user_id=97540f5f152a4a8d9c4d36afac2baafa, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.753505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.760030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfdcff5-8a14-4efd-9e35-62ea18adf404 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:09.766637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:09.767349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.767769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.768154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.787792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:09.789491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d1733-a34a-4106-ad83-cc8df95cc047 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:09.804662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1051/2080] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:09.836884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1030/2081] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:09 2022] PUT /identity/v3/projects/7fc280705af54fcdad1e708ecdfff2d2/users/97540f5f152a4a8d9c4d36afac2baafa/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:09.848971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:09.849498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:09.849911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:09.880189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] MFA Rules not processed for user `97540f5f152a4a8d9c4d36afac2baafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:09.881791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:09.952614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1052/2082] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:09.966558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:09.983908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:10.061048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:10.083458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f85324-dc4a-41bf-bcb3-5d26bb78664b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:10.088215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:10.088933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:10.089249 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:10.089529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:10.100674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:10.102517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:10.119131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1031/2083] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:10.318722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:10.320800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:10.334804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:10.417181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af664b1c-0bbc-4dea-9d0b-88f4963fe9cf None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:10.422039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:10.423533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:10.423823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:10.424100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] PATH_INFO: `/v3/projects/bba31ac669f64bb8be1c26d0dad7b4ac` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:10.425353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba31ac669f64bb8be1c26d0dad7b4ac)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:10.428075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:10.579497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba31ac669f64bb8be1c26d0dad7b4ac', 'request_id': 'req-7a430032-4cfc-4498-b542-3fb78c9c1ca5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.641381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:10.643534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:10.648409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba31ac669f64bb8be1c26d0dad7b4ac', 'request_id': 'req-7a430032-4cfc-4498-b542-3fb78c9c1ca5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.655797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba31ac669f64bb8be1c26d0dad7b4ac', 'request_id': 'req-7a430032-4cfc-4498-b542-3fb78c9c1ca5'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.659530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3605d8-1659-4af7-beab-14f28c8acfdf service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:10.686523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] The token cache is being invalidate because project bba31ac669f64bb8be1c26d0dad7b4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:10.686895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.690119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.693872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1053/2084] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:10 2022] DELETE /identity/v3/projects/bba31ac669f64bb8be1c26d0dad7b4ac => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:10.704549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:10.707789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:10.730712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:10.730712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:10.730712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:10.730712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] PATH_INFO: `/v3/projects/6ced3bf77d5f43cd9ef282c106432eb6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:10.731064 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ced3bf77d5f43cd9ef282c106432eb6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:10.731650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:10.822478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a430032-4cfc-4498-b542-3fb78c9c1ca5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:10.829204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:10.833454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:10.833454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:10.833454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] PATH_INFO: `/v3/users/92cc2f1728a8401bab686c304f4dd2e6` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:10.833454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92cc2f1728a8401bab686c304f4dd2e6)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:10.845618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:10.857478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ced3bf77d5f43cd9ef282c106432eb6', 'request_id': 'req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.945589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ced3bf77d5f43cd9ef282c106432eb6', 'request_id': 'req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.953455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ced3bf77d5f43cd9ef282c106432eb6', 'request_id': 'req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.984020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] The token cache is being invalidate because project 6ced3bf77d5f43cd9ef282c106432eb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:10.984463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.985280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:10.988597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1032/2085] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:10 2022] DELETE /identity/v3/projects/6ced3bf77d5f43cd9ef282c106432eb6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:10.994218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:10.996736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:11.060350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:11.067456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92cc2f1728a8401bab686c304f4dd2e6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.101562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0a573-4ec8-41b3-bf9f-5b895a6ef4b5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:11.108669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:11.110254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:11.110769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:11.111280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] PATH_INFO: `/v3/users/37165c3448f94485b5c5e86725c4e1a4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:11.112779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=37165c3448f94485b5c5e86725c4e1a4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:11.115891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:11.128086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92cc2f1728a8401bab686c304f4dd2e6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.132078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:11.146808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92cc2f1728a8401bab686c304f4dd2e6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.147717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92cc2f1728a8401bab686c304f4dd2e6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.156732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92cc2f1728a8401bab686c304f4dd2e6'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.166547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1054/2086] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:10 2022] DELETE /identity/v3/users/92cc2f1728a8401bab686c304f4dd2e6 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:11.329888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37165c3448f94485b5c5e86725c4e1a4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.397096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37165c3448f94485b5c5e86725c4e1a4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.399006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37165c3448f94485b5c5e86725c4e1a4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.416940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37165c3448f94485b5c5e86725c4e1a4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.426200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37165c3448f94485b5c5e86725c4e1a4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:11.443265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1033/2087] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:10 2022] DELETE /identity/v3/users/37165c3448f94485b5c5e86725c4e1a4 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:11.747072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:11.747072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:11.881396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6936f6-9e04-4e71-ba24-d6d0d228c6b3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:11.980239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:11.984563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:11.985037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:11.985313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] PATH_INFO: `/v3/projects/13a560fa7c7c462bb59bbeac2a51782f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:11.986771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a560fa7c7c462bb59bbeac2a51782f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:11.989297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.074356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.078288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.104950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9080509c-7c38-4a05-a6e6-613f1b5a4eef admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.127639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a560fa7c7c462bb59bbeac2a51782f', 'request_id': 'req-ddbe47d8-063b-4a44-a93c-450f52ec9a34'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.183217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.186069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.186069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.186069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] PATH_INFO: `/v3/projects/62f0cf6da177419a85b22fb08247d78d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.186328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f0cf6da177419a85b22fb08247d78d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.188168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.201482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a560fa7c7c462bb59bbeac2a51782f', 'request_id': 'req-ddbe47d8-063b-4a44-a93c-450f52ec9a34'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.209217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a560fa7c7c462bb59bbeac2a51782f', 'request_id': 'req-ddbe47d8-063b-4a44-a93c-450f52ec9a34'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.215163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:12.221712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] The token cache is being invalidate because project 13a560fa7c7c462bb59bbeac2a51782f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:12.222000 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.223859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ddbe47d8-063b-4a44-a93c-450f52ec9a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.225397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1055/2088] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:11 2022] DELETE /identity/v3/projects/13a560fa7c7c462bb59bbeac2a51782f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:12.230349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221c2e-efc7-472b-b5ee-7cc9c6f524d9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.232140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221c2e-efc7-472b-b5ee-7cc9c6f524d9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.232140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe221c2e-efc7-472b-b5ee-7cc9c6f524d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.249287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-fe221c2e-efc7-472b-b5ee-7cc9c6f524d9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:12.250469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fe221c2e-efc7-472b-b5ee-7cc9c6f524d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.258426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1056/2089] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:12.265838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.266126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.266423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.284444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:12.286585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.294738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1057/2090] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:12.301383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.309314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34231ea4-975b-44f6-9962-1c7a16c6ec32 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.345503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f0cf6da177419a85b22fb08247d78d', 'request_id': 'req-f9d95e61-4173-41a7-8931-8031d39a2f12'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.387830 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.388842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.389284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.389479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.390220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:12.390525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.392138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.409133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1058/2091] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:12.413359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.423516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ce3847-a21b-4f66-8766-52b031046a78 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.429162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.430193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.430481 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.430782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.431534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.431847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f0cf6da177419a85b22fb08247d78d', 'request_id': 'req-f9d95e61-4173-41a7-8931-8031d39a2f12'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.433844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.446033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f0cf6da177419a85b22fb08247d78d', 'request_id': 'req-f9d95e61-4173-41a7-8931-8031d39a2f12'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.455998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] The token cache is being invalidate because project 62f0cf6da177419a85b22fb08247d78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:12.456404 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.457816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f9d95e61-4173-41a7-8931-8031d39a2f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:12.466949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1034/2092] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:12 2022] DELETE /identity/v3/projects/62f0cf6da177419a85b22fb08247d78d => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:12.472921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e00ab-6894-4794-9b3f-a9bdacd089c1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.472921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e00ab-6894-4794-9b3f-a9bdacd089c1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.473419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e00ab-6894-4794-9b3f-a9bdacd089c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.510099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-090e00ab-6894-4794-9b3f-a9bdacd089c1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:12.510412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-090e00ab-6894-4794-9b3f-a9bdacd089c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.519079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1035/2093] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:12.527444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.527724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.528006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.548629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:12.549898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.564079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1036/2094] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:12.564079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.573533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed14b6-c59b-4326-9367-b23505136bd8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.579219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.581799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.581799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.581799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.581799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:12.581799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.583263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.585642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:12.598987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1037/2095] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:12.603640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.607849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1059/2096] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/projects => generated 383 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:12.611831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.614495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:12.615957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839674a2-eaf2-4fa9-accb-182f3138dfed admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.681400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.682602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60421f4-47e8-498a-a479-2e400e738140 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.682725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.683134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.683439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.684144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.686190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.689166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.690032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.690469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.690765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.691613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.694010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.803591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1060/2097] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:12.809203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.821447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1038/2098] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:12.833100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.836529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2035-336c-4215-89e8-e889e261713e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.930113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.930959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.931255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.931672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.932308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.934255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.950894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:12.966150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1061/2099] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:12.969583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb6b6-42f4-48f7-9f6e-cfbabc23193c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.969685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:12.984608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e3e673-5249-4184-a114-366233dbee7b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:12.986217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.987217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.987512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.987793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:12.990592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:12.992763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:12.996104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:12.997597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:12.998098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:12.998769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.000108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.002825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.018408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1062/2100] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:27:13.023945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.043403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc18486-4aea-4280-856f-a5eab33c5339 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.049855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.052442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.052931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.053505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] PATH_INFO: `/v3/projects/4b7d402643b943c087b553becaea8428/users/173e464dc89e4c72915b477fab16e1bf/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.074295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b7d402643b943c087b553becaea8428, user_id=173e464dc89e4c72915b477fab16e1bf, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.077401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8396d3-e0dc-4f40-83ac-3b9a71ef9742 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.161298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1039/2101] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:12 2022] POST /identity/v3/users => generated 288 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:13.162392 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.172721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc34cbd-2752-41d4-9820-e3ba52d95c65 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.185666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.186937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.187400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.187902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.189003 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.191732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.196640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1063/2102] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:13 2022] PUT /identity/v3/projects/4b7d402643b943c087b553becaea8428/users/173e464dc89e4c72915b477fab16e1bf/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:13.198222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.198513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.198800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.209648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1040/2103] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:27:13.211403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.228666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ea46a-8798-412a-a531-2d6257aa77d7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.252286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] MFA Rules not processed for user `173e464dc89e4c72915b477fab16e1bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:13.253582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:13.307031 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:13.319601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.320363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.320718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.321340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.321990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.323919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.340991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1041/2104] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:13.342659 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.349921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1064/2105] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:13.353247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368698e3-c24a-44e6-ace3-ac0ab9d9a716 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.359198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.361661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.361661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.361661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] PATH_INFO: `/v3/projects/8a8e71353f8a482bb90d7cecd4bab9f4/users/5081de14ce2342e2995baf4b2b800b8a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.362044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.363158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:13.380419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8e71353f8a482bb90d7cecd4bab9f4, user_id=5081de14ce2342e2995baf4b2b800b8a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.383197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.427158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fe26d-6778-4c3f-947f-1f84dacc6197 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.433134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.433134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.433134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.433134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.447870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.449478 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa07371-4e50-469b-b569-2d0a163e03bb service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.461785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1065/2106] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:13.501870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1042/2107] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:13 2022] PUT /identity/v3/projects/8a8e71353f8a482bb90d7cecd4bab9f4/users/5081de14ce2342e2995baf4b2b800b8a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:13.514745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.515066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.515579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.545609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] MFA Rules not processed for user `5081de14ce2342e2995baf4b2b800b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:13.546732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:13.554103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.556489 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:13.581321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:13.636933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1066/2108] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:13.641628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.645592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de39f-a9b0-4527-8b26-8f9c66cb78db admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.650368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.651247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.651525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.651795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] PATH_INFO: `/v3/users/cdb7fe3950e54a72ae60c122b1cece8c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.652455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662b811-e7ba-4811-8c9f-93ed60b52f73 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.653144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb7fe3950e54a72ae60c122b1cece8c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.655243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.657173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.657822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.658156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.658434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.659135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.661248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.755941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1067/2109] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:13 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:13.757662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.840113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93957f2c-8d4c-4aed-9f71-5fd8f03248ba admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.845296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.845987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.846261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.846946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.847517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.849483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:13.968615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb7fe3950e54a72ae60c122b1cece8c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:13.968712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1068/2110] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:13 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:13.981161 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:13.987503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab442d2-647d-4d0c-843c-0f9dc7a67a30 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:13.993558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:13.994283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:13.994567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:13.994860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:13.995625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:13.997237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.008370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1069/2111] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:14.012657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.013607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb7fe3950e54a72ae60c122b1cece8c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.014289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb7fe3950e54a72ae60c122b1cece8c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.024451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9884736-48a6-4223-a220-c015c4d2164f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.029407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.030221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.030511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.030784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] PATH_INFO: `/v3/projects/bfb9bf848e4147fca792db2aa2c8c387/users/de56b9b5571d4df5a8d23788ecdf18ed/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.034119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb7fe3950e54a72ae60c122b1cece8c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.044671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb7fe3950e54a72ae60c122b1cece8c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.052164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb9bf848e4147fca792db2aa2c8c387, user_id=de56b9b5571d4df5a8d23788ecdf18ed, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.055566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1043/2112] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:13 2022] DELETE /identity/v3/users/cdb7fe3950e54a72ae60c122b1cece8c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:14.057603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.123803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1070/2113] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:14 2022] PUT /identity/v3/projects/bfb9bf848e4147fca792db2aa2c8c387/users/de56b9b5571d4df5a8d23788ecdf18ed/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:14.127748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.129583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.202749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:14.224668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4068bcf4-afa1-4863-ba7c-fb1caf3c8301 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.291922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.292682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.292964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.293280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.294066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.295757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0792d-3e8e-45d2-afef-5f2273ce68d8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.307438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1044/2114] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:14.311837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.323259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7968e48a-60b2-4243-bd08-0eb715f92786 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.328366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.329317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.329598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.329871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] PATH_INFO: `/v3/projects/bfb9bf848e4147fca792db2aa2c8c387/users/de56b9b5571d4df5a8d23788ecdf18ed/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.332033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb9bf848e4147fca792db2aa2c8c387, user_id=de56b9b5571d4df5a8d23788ecdf18ed, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.334723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.348111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1071/2115] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:14 2022] PUT /identity/v3/projects/bfb9bf848e4147fca792db2aa2c8c387/users/de56b9b5571d4df5a8d23788ecdf18ed/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:14.359648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.359940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.360222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.374239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.377860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.409216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] MFA Rules not processed for user `de56b9b5571d4df5a8d23788ecdf18ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:14.410641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.447623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:14.465310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b88f8b-11c2-4aa1-a117-694e03582977 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.470141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.471026 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.471291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.471569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] PATH_INFO: `/v3/projects/1388398a0d65436ab322eea57c5a829e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.472807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1388398a0d65436ab322eea57c5a829e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.474785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.484413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1045/2116] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:14.495959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.497501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.555747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578c8d6-24cf-495b-a589-8f2ab8007140 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.559467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.560160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.560471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.560791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.562600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.593502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1388398a0d65436ab322eea57c5a829e', 'request_id': 'req-836a9687-3cbf-4b53-817c-381427c0db39'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.599748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:14.627465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.629774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d5b9f-c168-4b85-8802-cd233457f5a8 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.638723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1046/2117] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:14.688526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1388398a0d65436ab322eea57c5a829e', 'request_id': 'req-836a9687-3cbf-4b53-817c-381427c0db39'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.696987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1388398a0d65436ab322eea57c5a829e', 'request_id': 'req-836a9687-3cbf-4b53-817c-381427c0db39'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.710699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] The token cache is being invalidate because project 1388398a0d65436ab322eea57c5a829e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:14.711245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.711936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-836a9687-3cbf-4b53-817c-381427c0db39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:14.713672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1072/2118] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:14 2022] DELETE /identity/v3/projects/1388398a0d65436ab322eea57c5a829e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:14.718882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.719113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.719395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.742238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:14.743520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.810016 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1047/2119] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:14.819020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.819305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.819581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.837941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:14.839128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:14.847791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1073/2120] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:14.852009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.861639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905efdee-073d-447b-aaba-352e26d310c1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.866886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.867539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.867818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.868094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.868818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:14.869194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.870788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:14.883182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1048/2121] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:27:14.887522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:14.897641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0923d2-8126-4505-bfdc-5b96b8c428db None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:14.902662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:14.903462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:14.904938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:14.905268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:14.905988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:14.908022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.020018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1074/2122] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:14 2022] POST /identity/v3/projects => generated 393 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:15.024104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:15.036528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300be8fe-2019-4b2a-95f2-bc57f72353cb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:15.094299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:15.094970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.095251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.095526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.096216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:15.099001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.219428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1049/2123] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:15 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:15.224293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:15.234949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1efce-022b-4f82-b4ca-6c017a2fffbf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:15.239457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:15.240104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.240386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.243487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.243487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:15.243487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.253544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1075/2124] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:15.257475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:15.267478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7bf6f-c2f6-485f-b4aa-ade3e388e604 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:15.272692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:15.273386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.273674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.273952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.274682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:15.276256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26cc45-c970-4083-a9c9-ab27406e16d0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.286847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1050/2125] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:15.290848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:15.301065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162d1d4-6b90-417a-84ad-fd622d3e3614 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:15.305567 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:15.306433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.306714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.306991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] PATH_INFO: `/v3/projects/33d41c90c5d84426adb80aa141d3b794/users/6ebf13c104564589a51fa45f8c1e6126/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.322793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d41c90c5d84426adb80aa141d3b794, user_id=6ebf13c104564589a51fa45f8c1e6126, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:15.325568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.407453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1076/2126] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:15 2022] PUT /identity/v3/projects/33d41c90c5d84426adb80aa141d3b794/users/6ebf13c104564589a51fa45f8c1e6126/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:15.412668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.412961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.413280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.442760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:15.446501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:15.494482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:15.534649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1051/2127] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:15.548582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:15.550695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:15.619024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68a36f-456f-4c36-abe2-3a3159f4443c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:15.622765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:15.623418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:15.623704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:15.623984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:15.634109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:15.635687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0141b-7102-4656-b902-928383fd024f service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:15.646006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1077/2128] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:17.965428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:17.966932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:17.989017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e7445-ffbe-4bc0-b9ae-55132c42be37 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:18.009862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:18.010803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:18.011235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:18.011524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] PATH_INFO: `/v3/users/5081de14ce2342e2995baf4b2b800b8a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:18.013413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5081de14ce2342e2995baf4b2b800b8a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:18.017747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:18.220767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5081de14ce2342e2995baf4b2b800b8a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:18.288136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5081de14ce2342e2995baf4b2b800b8a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:18.288962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5081de14ce2342e2995baf4b2b800b8a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:18.305777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5081de14ce2342e2995baf4b2b800b8a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:18.313343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5081de14ce2342e2995baf4b2b800b8a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:18.320441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1052/2129] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:17 2022] DELETE /identity/v3/users/5081de14ce2342e2995baf4b2b800b8a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:18.325054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:18.325564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:18.325654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:18.344064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:18.345304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:18.355411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:18.426602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1078/2130] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:18.434655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:18.436999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:18.517093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db44df1-e90d-4c4f-98c4-69c7902d5d2d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:18.523186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:18.523980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:18.524383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:18.524730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:18.535795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:18.537475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:18.548532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1053/2131] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:19.091004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:19.092935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:19.122930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2998a5e-45cb-4a8b-a141-4f465f8002d7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:19.138405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:19.139306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:19.139594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:19.139870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] PATH_INFO: `/v3/projects/8a8e71353f8a482bb90d7cecd4bab9f4` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:19.142492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8e71353f8a482bb90d7cecd4bab9f4)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:19.145448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:19.320344 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8e71353f8a482bb90d7cecd4bab9f4', 'request_id': 'req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.415042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8e71353f8a482bb90d7cecd4bab9f4', 'request_id': 'req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.426203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8e71353f8a482bb90d7cecd4bab9f4', 'request_id': 'req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.439067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] The token cache is being invalidate because project 8a8e71353f8a482bb90d7cecd4bab9f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:19.439625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.440712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.444437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1079/2132] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:19 2022] DELETE /identity/v3/projects/8a8e71353f8a482bb90d7cecd4bab9f4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:19.448865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:19.462050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83fdb2-a3b4-4368-90a7-973fa06e514d service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:19.535457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:19.546403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:19.547416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:19.547802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:19.548188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] PATH_INFO: `/v3/users/de56b9b5571d4df5a8d23788ecdf18ed` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:19.549630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de56b9b5571d4df5a8d23788ecdf18ed)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:19.552695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:19.809389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de56b9b5571d4df5a8d23788ecdf18ed'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.915883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de56b9b5571d4df5a8d23788ecdf18ed'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.917444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de56b9b5571d4df5a8d23788ecdf18ed'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.939985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de56b9b5571d4df5a8d23788ecdf18ed'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.950804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de56b9b5571d4df5a8d23788ecdf18ed'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:19.959349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1054/2133] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:19 2022] DELETE /identity/v3/users/de56b9b5571d4df5a8d23788ecdf18ed => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:20.704943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:20.709596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:20.749832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc757c-b5ea-4123-a3fa-1e8e7c432c02 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:20.847904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:20.848867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:20.849234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:20.849516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] PATH_INFO: `/v3/projects/bfb9bf848e4147fca792db2aa2c8c387` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:20.851822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb9bf848e4147fca792db2aa2c8c387)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:20.853824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.025232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.026954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.043633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79447695-be07-4632-bd5c-2caeaf1331b4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.055235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:21.065203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb9bf848e4147fca792db2aa2c8c387', 'request_id': 'req-b6e180af-190a-4cfd-b947-cfa628240b44'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.169155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb9bf848e4147fca792db2aa2c8c387', 'request_id': 'req-b6e180af-190a-4cfd-b947-cfa628240b44'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.170037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.173411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.173951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.174412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] PATH_INFO: `/v3/users/173e464dc89e4c72915b477fab16e1bf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.177471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] RBAC: Authorizing `identity:delete_user(user_id=173e464dc89e4c72915b477fab16e1bf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.178349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb9bf848e4147fca792db2aa2c8c387', 'request_id': 'req-b6e180af-190a-4cfd-b947-cfa628240b44'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.180174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.201049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] The token cache is being invalidate because project bfb9bf848e4147fca792db2aa2c8c387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:21.201774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.218366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b6e180af-190a-4cfd-b947-cfa628240b44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.218366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1080/2134] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:20 2022] DELETE /identity/v3/projects/bfb9bf848e4147fca792db2aa2c8c387 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:21.218366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d92f2-bfd6-4efb-a9b7-9bfa36621446 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.218366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d92f2-bfd6-4efb-a9b7-9bfa36621446 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.218366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d92f2-bfd6-4efb-a9b7-9bfa36621446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.241168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-637d92f2-bfd6-4efb-a9b7-9bfa36621446 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:21.242813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-637d92f2-bfd6-4efb-a9b7-9bfa36621446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.258661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1081/2135] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:21.260311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.260605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.261855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.285329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:21.287162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.299096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1082/2136] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:21.303782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.315332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ddc43-5c63-49ba-8bd0-b4598cb76133 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.322143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.323335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.323653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.323964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.324713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:21.325115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.330167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.345152 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1083/2137] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:27:21.349568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.384916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c7318-6dbc-4a59-b5c8-a43ad0de1556 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.392135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.393008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.393408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.393864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.395604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.397795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.472816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173e464dc89e4c72915b477fab16e1bf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.582630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1084/2138] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/projects => generated 397 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:21.586832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.603160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173e464dc89e4c72915b477fab16e1bf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.603872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173e464dc89e4c72915b477fab16e1bf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.623593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173e464dc89e4c72915b477fab16e1bf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.626175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:21.639754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ff97facc-1995-4f37-bc77-d5482334774e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173e464dc89e4c72915b477fab16e1bf'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:21.647539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1055/2139] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:21 2022] DELETE /identity/v3/users/173e464dc89e4c72915b477fab16e1bf => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:21.649144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0134-5fba-40e6-8a41-488ded93e54f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.650235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0134-5fba-40e6-8a41-488ded93e54f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.650653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0134-5fba-40e6-8a41-488ded93e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.690194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-183d0134-5fba-40e6-8a41-488ded93e54f None None] MFA Rules not processed for user `6ebf13c104564589a51fa45f8c1e6126`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:21.691675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-183d0134-5fba-40e6-8a41-488ded93e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.696336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5081849-786c-4005-9fad-ed5992743f9d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.767038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.767917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.768346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.769513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.770783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.774254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.817515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1056/2140] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:21.817515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb291d73-f308-4ac9-ac3e-e2d207cd1b34 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.817515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb291d73-f308-4ac9-ac3e-e2d207cd1b34 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.817515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb291d73-f308-4ac9-ac3e-e2d207cd1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.837306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eb291d73-f308-4ac9-ac3e-e2d207cd1b34 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:21.838534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eb291d73-f308-4ac9-ac3e-e2d207cd1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.849217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1057/2141] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:21.850554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.850848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.851134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.853573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1085/2142] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:21.857287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.859410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.877096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3aa3e-d7bf-4b62-9c7e-ac11c48a841b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.883370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.883810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.884096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.884558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.885202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] MFA Rules not processed for user `6ebf13c104564589a51fa45f8c1e6126`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:21.885318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.886149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.887543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:21.895280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1058/2143] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:21.896019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.897697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.906047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1086/2144] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:21.907010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:21.908990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:21.969140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:21.972574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc003-ff11-45c0-b863-6cfdd40d51d8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:21.976620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:21.977332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:21.991304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:21.991304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:21.991304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:21.991304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.000427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1059/2145] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:22.006419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:22.015658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724d3c-c45e-4528-8834-ba2804bb0d78 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:22.024328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:22.025165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.026411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.026411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.029384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2c80a-ca9a-4aab-9c65-c64de3c37521 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:22.035003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:22.036242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:22.036958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.037123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.037432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.037992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.038998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:22.040826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13624-ca46-4ec3-8639-61a87b1a73d0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.047002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1087/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:22.057319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1060/2147] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:22.061619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:22.072912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f85129-04c2-4dd2-bc28-3f1e357f321c service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:22.081007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:22.082609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.082875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.083145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] PATH_INFO: `/v3/projects/44211c9443454d9293061abd41625858/users/4d1464c595b2413db69a86ff162981c0/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.118437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44211c9443454d9293061abd41625858, user_id=4d1464c595b2413db69a86ff162981c0, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:22.121295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.216442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1088/2148] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:22 2022] PUT /identity/v3/projects/44211c9443454d9293061abd41625858/users/4d1464c595b2413db69a86ff162981c0/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:22.227591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.227943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.228296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.262273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] MFA Rules not processed for user `4d1464c595b2413db69a86ff162981c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:22.263508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:22.344167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1061/2149] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:22.358747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:22.360669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:22.427114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6992188-f5ee-494b-a7b0-adde11193722 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:22.430906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:22.431612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.434602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.434602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.442421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:22.444500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4677fba-3e44-4344-99ac-d571836372ff service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.454203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1089/2150] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:22.606129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:22.609147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:22.733940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:22.760238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fba70-ebee-4b2a-8da6-ccad90a97191 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:22.766085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:22.767764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:22.768815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:22.769163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] PATH_INFO: `/v3/projects/4b7d402643b943c087b553becaea8428` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:22.770497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b7d402643b943c087b553becaea8428)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:22.773187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:22.946282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b7d402643b943c087b553becaea8428', 'request_id': 'req-faac7369-9011-4198-8db8-a909f6b70ae0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:23.031643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b7d402643b943c087b553becaea8428', 'request_id': 'req-faac7369-9011-4198-8db8-a909f6b70ae0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:23.040800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b7d402643b943c087b553becaea8428', 'request_id': 'req-faac7369-9011-4198-8db8-a909f6b70ae0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:23.067573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025e85-1fce-4762-8b35-ea10184a36c3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.068395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025e85-1fce-4762-8b35-ea10184a36c3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.069519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f025e85-1fce-4762-8b35-ea10184a36c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.070113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] The token cache is being invalidate because project 4b7d402643b943c087b553becaea8428 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:23.071021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:23.072350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faac7369-9011-4198-8db8-a909f6b70ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:23.074607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1062/2151] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:22 2022] DELETE /identity/v3/projects/4b7d402643b943c087b553becaea8428 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:23.079253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.081239 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.081999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.092786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5f025e85-1fce-4762-8b35-ea10184a36c3 None None] MFA Rules not processed for user `6ebf13c104564589a51fa45f8c1e6126`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:23.098640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5f025e85-1fce-4762-8b35-ea10184a36c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:23.127952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:23.134085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:23.180509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1090/2152] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:23.261838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1063/2153] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:23.270027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.272604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.272829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.293099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:23.296394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:23.306417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1091/2154] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:23.310607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.322637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85954a-ebf2-475c-9a64-f4db1d2fce11 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.327993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.328765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.329204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.329563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.330417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:23.330796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.333128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:23.349422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1064/2155] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:27:23.353558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.365640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc16a6-b24c-4a9e-b0d7-2255bbe7db3e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.371388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.373755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.374767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.375562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.376950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.380855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:23.407834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:23.538175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1092/2156] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:23 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:23.542188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.562150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63616dcd-eb5e-4ea4-9328-ea8567c9ca31 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.572019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:23.634209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.635007 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.635356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.635640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.636354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.638301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:23.746423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1065/2157] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:23 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:23.750345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.763352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2188a-6e0b-4c1a-b8f1-ed631725e93e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.785697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.786396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.793242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.793890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.794864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.798130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:23.827627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1093/2158] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:23.829480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.846736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90067b-187f-4fbb-8796-140ec40efd5a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.852919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.853601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.853952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.854292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.855110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.856955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e334e82-3340-4935-8483-518e9a6aaaf6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:23.872032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1066/2159] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:23.876173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:23.889187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8e25d7-9d87-43a3-a150-f6788c20fcce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:23.896573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:23.897672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:23.898050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:23.898454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] PATH_INFO: `/v3/projects/8b0d05110c3b406584df9f0768dcd548/users/dd25287e3aac438197ae1fab4b6f257c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:23.921080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b0d05110c3b406584df9f0768dcd548, user_id=dd25287e3aac438197ae1fab4b6f257c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:23.924528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:24.024866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1094/2160] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:23 2022] PUT /identity/v3/projects/8b0d05110c3b406584df9f0768dcd548/users/dd25287e3aac438197ae1fab4b6f257c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:24.033906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.034823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.035278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.116784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] MFA Rules not processed for user `dd25287e3aac438197ae1fab4b6f257c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:24.133673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:24.226128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1067/2161] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:24.232887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:24.329208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eacf16-6abb-4a0d-af47-7e46f288b39c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:24.337300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:24.337300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.337300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.337300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.337712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:24.339480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:24.468907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1095/2162] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:24 2022] POST /identity/v3/projects => generated 383 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:24.472520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:24.486798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783a67-b53b-4dcd-92dc-393b4494ebe2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:24.666291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:24.669384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.669890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.670172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.673047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:24.676931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:24.779417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1068/2163] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:24 2022] POST /identity/v3/users => generated 292 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:24.779815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:24.797958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43655-9fbc-4ed9-900f-e10809623402 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:24.805464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:24.806325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.806664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.806952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.807705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:24.809808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:24.826719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1096/2164] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:24.831190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:24.843895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:24.851132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0966b-bb95-4598-9190-20abbf54ce65 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:24.861141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:24.861986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.862386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.862830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.863785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:24.865700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e824ba-31cc-4656-99d1-24d9605cbbc6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:24.885709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1069/2165] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:24.890621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:24.910057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8162520-e107-4ba7-85ee-dadedf7001ed admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:24.927463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:24.930400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:24.930400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:24.930400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] PATH_INFO: `/v3/projects/330899ebdad84c2d9afebe1bc941a5e9/users/a3e5b18af5a940d79ff270d9e6a56b7f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:24.954562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=330899ebdad84c2d9afebe1bc941a5e9, user_id=a3e5b18af5a940d79ff270d9e6a56b7f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:24.958981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:25.051208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1097/2166] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:24 2022] PUT /identity/v3/projects/330899ebdad84c2d9afebe1bc941a5e9/users/a3e5b18af5a940d79ff270d9e6a56b7f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:25.062624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:25.063156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:25.063309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:25.099339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] MFA Rules not processed for user `a3e5b18af5a940d79ff270d9e6a56b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:25.100467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:25.169459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1070/2167] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:25.173929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:25.354207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5ff24-2a51-418e-be95-2ea24bee4446 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:25.360526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:25.363930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:25.363930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:25.363930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:25.363930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:25.365691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:25.374339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:25.496610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1098/2168] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:25 2022] POST /identity/v3/projects => generated 383 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:25.501011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:25.512424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ce31f-25cf-41d9-b1f9-21029b925199 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:25.582817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:25.583537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:25.583822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:25.584103 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:25.584844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:25.587096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:25.720174 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1071/2169] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:25 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:25.725040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:25.736686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead25e4a-c614-48c1-b348-2863ec0a3605 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:25.746906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:25.747599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:25.747908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:25.748172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:25.748919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:25.750618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:25.773254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1099/2170] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:25.775051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:25.801578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81058059-0ce7-4a78-8407-d0a8e1434b61 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:25.806288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:25.807181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:25.807462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:25.808507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] PATH_INFO: `/v3/projects/763b80567be946a4984a5297e37fdadd/users/89884c78e9454ff19847803cc83d3541/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:25.826055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763b80567be946a4984a5297e37fdadd, user_id=89884c78e9454ff19847803cc83d3541, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:25.828775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:25.913538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1072/2171] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:25 2022] PUT /identity/v3/projects/763b80567be946a4984a5297e37fdadd/users/89884c78e9454ff19847803cc83d3541/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:25.915259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:25.926025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c0fc1-fc7a-4005-8a4f-1b9473ea5453 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:26.006698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:26.007848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:26.008386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:26.009351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:26.010439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:26.012444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b254e6-628d-48cf-a48d-12b4d882cad5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:26.028073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1100/2172] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:26.032028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:26.045359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab0812f-c1fd-4d14-a1a8-1c6faa1d2b55 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:26.051597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:26.052576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:26.052983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:26.053317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] PATH_INFO: `/v3/projects/763b80567be946a4984a5297e37fdadd/users/89884c78e9454ff19847803cc83d3541/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:26.056339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=763b80567be946a4984a5297e37fdadd, user_id=89884c78e9454ff19847803cc83d3541, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:26.059556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:26.077277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1073/2173] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:26 2022] PUT /identity/v3/projects/763b80567be946a4984a5297e37fdadd/users/89884c78e9454ff19847803cc83d3541/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:26.084613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:26.085951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:26.086561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:26.125758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] MFA Rules not processed for user `89884c78e9454ff19847803cc83d3541`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:26.127038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:26.208687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1101/2174] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:26.221609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:26.223966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:26.270963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:26.292711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82916918-6eea-44f0-af38-8779f7f3f53d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:26.296370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:26.297139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:26.297332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:26.297612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:26.358857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:26.360355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:26.381943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1074/2175] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:29.037985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:29.039450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:29.052836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8c71f5-4b66-40d3-9aa4-f91f11777d8c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:29.057219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:29.058218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:29.058493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:29.058878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:29.131551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:29.134882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:29.136874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39245a-d967-4504-b9f7-e159557da704 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:29.161977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1102/2176] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:29.602594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:29.604630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:29.674871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da09a910-09d5-461d-ac19-3c49fbb4b217 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:29.680131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:29.681067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:29.681355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:29.681648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] PATH_INFO: `/v3/users/4d1464c595b2413db69a86ff162981c0` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:29.682832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1464c595b2413db69a86ff162981c0)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:29.684812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:29.914437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1464c595b2413db69a86ff162981c0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:29.990945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1464c595b2413db69a86ff162981c0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:29.991568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1464c595b2413db69a86ff162981c0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:30.005690 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1464c595b2413db69a86ff162981c0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:30.013057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1464c595b2413db69a86ff162981c0'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:30.021014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1075/2177] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:29 2022] DELETE /identity/v3/users/4d1464c595b2413db69a86ff162981c0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:30.029691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:30.029988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:30.030271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:30.052666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:30.054793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:30.130140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1103/2178] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:30.139827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:30.141286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:30.153110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:30.204307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f129b-2c11-4159-91a9-b7d62671be18 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:30.211921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:30.212614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:30.212904 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:30.213275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:30.223516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:30.224966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:30.236721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1076/2179] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:30.685479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:30.687003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:30.700494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0b4ce-defb-4318-9b50-332dd9765c26 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:30.705314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:30.706210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:30.707085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:30.709166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] PATH_INFO: `/v3/users/97540f5f152a4a8d9c4d36afac2baafa` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:30.709166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=97540f5f152a4a8d9c4d36afac2baafa)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:30.710734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:30.771096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:30.772985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:30.787639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b54b90-e9d6-4369-9eb1-34553ce759a5 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:30.792590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:30.794071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:30.795190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:30.802017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] PATH_INFO: `/v3/projects/44211c9443454d9293061abd41625858` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:30.803522 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] RBAC: Authorizing `identity:delete_project(project_id=44211c9443454d9293061abd41625858)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:30.805802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:30.928716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97540f5f152a4a8d9c4d36afac2baafa'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:30.957971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44211c9443454d9293061abd41625858', 'request_id': 'req-3800f7be-2e4d-4d3e-971f-0225d509dbee'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.007963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97540f5f152a4a8d9c4d36afac2baafa'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.021529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97540f5f152a4a8d9c4d36afac2baafa'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.022365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97540f5f152a4a8d9c4d36afac2baafa'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.029392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97540f5f152a4a8d9c4d36afac2baafa'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.040794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1104/2180] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:30 2022] DELETE /identity/v3/users/97540f5f152a4a8d9c4d36afac2baafa => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:31.041765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:31.043170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:31.052640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44211c9443454d9293061abd41625858', 'request_id': 'req-3800f7be-2e4d-4d3e-971f-0225d509dbee'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.059026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44211c9443454d9293061abd41625858', 'request_id': 'req-3800f7be-2e4d-4d3e-971f-0225d509dbee'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.073220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] The token cache is being invalidate because project 44211c9443454d9293061abd41625858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:31.074068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.074631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3800f7be-2e4d-4d3e-971f-0225d509dbee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:31.076662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1077/2181] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:30 2022] DELETE /identity/v3/projects/44211c9443454d9293061abd41625858 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:31.078024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:31.078556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:31.078940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:31.101182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:31.102709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:31.140392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1331264-a769-43ca-8d16-7d724151f2fd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:31.156540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:31.157678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:31.158389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:31.158816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:31.163656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:31.214229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1078/2182] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:31.226430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:31.228464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:31.228588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:31.317886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:31.339980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:31.342726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e924b-d19f-43f3-9e9d-b636c472e977 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:31.343640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead0158-17dc-4dfb-9751-e29c8e4c9a41 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:31.347974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:31.348706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:31.349129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:31.349471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:31.360697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:31.362215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:31.374949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1079/2183] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:31.382088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1105/2184] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:31.813458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:31.816528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:31.838533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c7045-ada6-4199-834d-a4dc0ab89208 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:31.843652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:31.847759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:31.847759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:31.847759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] PATH_INFO: `/v3/projects/7fc280705af54fcdad1e708ecdfff2d2` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:31.847759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc280705af54fcdad1e708ecdfff2d2)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:31.848478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:31.985116 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc280705af54fcdad1e708ecdfff2d2', 'request_id': 'req-4116f5e2-d599-4334-a611-b3ddb03e6e24'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:32.053096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc280705af54fcdad1e708ecdfff2d2', 'request_id': 'req-4116f5e2-d599-4334-a611-b3ddb03e6e24'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:32.058865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc280705af54fcdad1e708ecdfff2d2', 'request_id': 'req-4116f5e2-d599-4334-a611-b3ddb03e6e24'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:32.070758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] The token cache is being invalidate because project 7fc280705af54fcdad1e708ecdfff2d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:32.071205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:32.071890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4116f5e2-d599-4334-a611-b3ddb03e6e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:32.073540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1080/2185] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:31 2022] DELETE /identity/v3/projects/7fc280705af54fcdad1e708ecdfff2d2 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:32.078513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.078799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.087894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.098089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:32.099290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:32.157895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1106/2186] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:32.166490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.168376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.168376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.185851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:32.187048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:32.195123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1081/2187] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:32.199245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.209448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564da5f-fc32-4dcf-b0af-257d930c25ee None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.214518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.215192 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.215476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.215785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.216513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:32.216821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.218480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.230909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1107/2188] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:27:32.235155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.245120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4837454-e9fc-4b79-addd-0b661eb67906 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.249812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.250459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.250744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.251024 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.251731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.253833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.319312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1082/2189] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:32 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:32.323508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.334424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd2a05-d4c6-4a6b-80b4-6fb0dfc695a8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.398372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.399050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.401182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.401182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.401182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.402230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.556587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1108/2190] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:32 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:32.564155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.574523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66ada6-7c62-403e-8a8c-6a0d5cf308c6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.579059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.579723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.580114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.580406 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.581689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.583389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.594650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1083/2191] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:32.599291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.609162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf7a2ef-3638-4555-b731-4c3f49ffdab4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.613802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.614446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.614727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.615001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.615754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.617352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e53a87a-9e4a-4e92-8a80-91f4c3aaaf2d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.627232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1109/2192] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:32.631677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.642509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbdc30-6582-4f4c-b1d4-c6cb2b1767a7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.647619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.648615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.648903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.649223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] PATH_INFO: `/v3/projects/8a0d3e91110d42f1925878d532f4ac9d/users/7497393918164e09ae6354906d783729/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.669063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a0d3e91110d42f1925878d532f4ac9d, user_id=7497393918164e09ae6354906d783729, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.671688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.745244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1084/2193] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:32 2022] PUT /identity/v3/projects/8a0d3e91110d42f1925878d532f4ac9d/users/7497393918164e09ae6354906d783729/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:32.750316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7ce3c-e3bb-405c-b55d-f3c75ee89eaa None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.750641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7ce3c-e3bb-405c-b55d-f3c75ee89eaa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.750916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7ce3c-e3bb-405c-b55d-f3c75ee89eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.769171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-02e7ce3c-e3bb-405c-b55d-f3c75ee89eaa None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:32.770391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-02e7ce3c-e3bb-405c-b55d-f3c75ee89eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:32.790283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:32.830485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1110/2194] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:32.841165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:32.843326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:32.901240 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec912201-98e8-44e3-8121-0a5fa49a3ae8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:32.905039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:32.905695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:32.905975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:32.906281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:32.915639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:32.917091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:32.921971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:32.926641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1085/2195] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:34.254626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:34.255146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:34.255242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:34.297513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] MFA Rules not processed for user `7497393918164e09ae6354906d783729`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:34.298949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:34.410542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1111/2196] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:34.421068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:34.422472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:34.495537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4022a2-aac0-4e03-8f29-1f779c896feb service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:34.499712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:34.500373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:34.500653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:34.503705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:34.511644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:34.513350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:34.525829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1086/2197] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:35.244820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:35.247265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:35.275458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6b2e-5f1e-4652-9878-cead4b58a1e4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:35.284030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:35.285668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:35.286474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:35.286776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] PATH_INFO: `/v3/users/91a2ef72ed63409bb6674ab64b0a9c33` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:35.288277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] RBAC: Authorizing `identity:delete_user(user_id=91a2ef72ed63409bb6674ab64b0a9c33)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:35.290596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:35.532320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91a2ef72ed63409bb6674ab64b0a9c33'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:35.646783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91a2ef72ed63409bb6674ab64b0a9c33'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:35.662022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91a2ef72ed63409bb6674ab64b0a9c33'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:35.663074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91a2ef72ed63409bb6674ab64b0a9c33'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:35.670912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91a2ef72ed63409bb6674ab64b0a9c33'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:35.678188 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1112/2198] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:35 2022] DELETE /identity/v3/users/91a2ef72ed63409bb6674ab64b0a9c33 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:35.973822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:35.986339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535c49d-5f18-400f-8fce-e3277f6d3f29 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:36.066994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:36.067987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.068272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.068555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] PATH_INFO: `/v3/projects/c4091588b9464aefa411e5676d50d1f7` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.069962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4091588b9464aefa411e5676d50d1f7)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:36.073976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:36.097297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:36.100268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:36.114410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a72bca-8dfc-4e00-8b5f-38ffaf61884e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:36.119695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:36.120596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.120872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.121174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] PATH_INFO: `/v3/users/dd25287e3aac438197ae1fab4b6f257c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.122364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd25287e3aac438197ae1fab4b6f257c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:36.124279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:36.147514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:36.228211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4091588b9464aefa411e5676d50d1f7', 'request_id': 'req-eb482fd1-8e62-4dab-95a1-3878239e0aab'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.328496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4091588b9464aefa411e5676d50d1f7', 'request_id': 'req-eb482fd1-8e62-4dab-95a1-3878239e0aab'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.335340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4091588b9464aefa411e5676d50d1f7', 'request_id': 'req-eb482fd1-8e62-4dab-95a1-3878239e0aab'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.343184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd25287e3aac438197ae1fab4b6f257c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.347870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] The token cache is being invalidate because project c4091588b9464aefa411e5676d50d1f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:36.348161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.348925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb482fd1-8e62-4dab-95a1-3878239e0aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.350581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1087/2199] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:35 2022] DELETE /identity/v3/projects/c4091588b9464aefa411e5676d50d1f7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:36.351960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.352251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.352529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.371477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] MFA Rules not processed for user `7497393918164e09ae6354906d783729`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:36.372688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:36.403146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:36.431566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1088/2200] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:36.432459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:36.433767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:36.476347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd25287e3aac438197ae1fab4b6f257c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.495175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd25287e3aac438197ae1fab4b6f257c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.495934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd25287e3aac438197ae1fab4b6f257c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.503965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0871803e-a2b0-4f86-a072-04d645dae4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd25287e3aac438197ae1fab4b6f257c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.509912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb93b1-edca-461c-aa00-7fe810b605f2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:36.510467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1113/2201] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:36 2022] DELETE /identity/v3/users/dd25287e3aac438197ae1fab4b6f257c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:36.514901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39018d0-866b-4812-9643-ce802c487542 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.515440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39018d0-866b-4812-9643-ce802c487542 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.515915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39018d0-866b-4812-9643-ce802c487542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.534789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f39018d0-866b-4812-9643-ce802c487542 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:36.536011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f39018d0-866b-4812-9643-ce802c487542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:36.572175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:36.573093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.573383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.573653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] PATH_INFO: `/v3/users/442b1ed8fce2412dbec8f72e83c54957` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.574963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442b1ed8fce2412dbec8f72e83c54957)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:36.576897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:36.605288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1114/2202] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:36.615905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39018d0-866b-4812-9643-ce802c487542 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:36.617411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f39018d0-866b-4812-9643-ce802c487542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:36.676087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39018d0-866b-4812-9643-ce802c487542 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:36.680381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:36.681050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:36.681363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:36.681644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:36.692413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:36.693956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:36.703807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1115/2203] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:27:36.816793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442b1ed8fce2412dbec8f72e83c54957'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.906366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442b1ed8fce2412dbec8f72e83c54957'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.907099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442b1ed8fce2412dbec8f72e83c54957'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.922653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442b1ed8fce2412dbec8f72e83c54957'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.935245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442b1ed8fce2412dbec8f72e83c54957'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:36.946286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1089/2204] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:36 2022] DELETE /identity/v3/users/442b1ed8fce2412dbec8f72e83c54957 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:37.169264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:37.170827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:37.199791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af02f2c-3fbc-4a7e-8f77-d9332a0db338 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:37.243706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:37.245647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:37.294136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:37.296446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.298085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.299245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] PATH_INFO: `/v3/projects/8b0d05110c3b406584df9f0768dcd548` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.303325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b0d05110c3b406584df9f0768dcd548)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:37.307647 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:37.390352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74001d2e-657c-46e7-8c48-43a8e7bf42e3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:37.398388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:37.399933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.400399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.400827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] PATH_INFO: `/v3/projects/c2565ff79301421497b55d44a4723c5f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.403348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2565ff79301421497b55d44a4723c5f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:37.406203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:37.525005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b0d05110c3b406584df9f0768dcd548', 'request_id': 'req-8ff4d6f5-b357-4310-a91f-de484350cb5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.563330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2565ff79301421497b55d44a4723c5f', 'request_id': 'req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.652613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b0d05110c3b406584df9f0768dcd548', 'request_id': 'req-8ff4d6f5-b357-4310-a91f-de484350cb5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.661127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b0d05110c3b406584df9f0768dcd548', 'request_id': 'req-8ff4d6f5-b357-4310-a91f-de484350cb5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.672258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] The token cache is being invalidate because project 8b0d05110c3b406584df9f0768dcd548 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:37.672545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.673224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.674895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1116/2205] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:37 2022] DELETE /identity/v3/projects/8b0d05110c3b406584df9f0768dcd548 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:37.678999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:37.680533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:37.751020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4d6f5-b357-4310-a91f-de484350cb5b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:37.779585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2565ff79301421497b55d44a4723c5f', 'request_id': 'req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.788840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2565ff79301421497b55d44a4723c5f', 'request_id': 'req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.807539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] The token cache is being invalidate because project c2565ff79301421497b55d44a4723c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:37.809336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.810455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-1a8466c1-6c20-4fd4-9a2d-7595026d20bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:37.813222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1090/2206] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:37 2022] DELETE /identity/v3/projects/c2565ff79301421497b55d44a4723c5f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:37.819299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf0f6a-ddb9-4c55-99fc-3881bbc5d899 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.819709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf0f6a-ddb9-4c55-99fc-3881bbc5d899 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.820069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf0f6a-ddb9-4c55-99fc-3881bbc5d899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.838255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:37.839137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.839418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.839748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] PATH_INFO: `/v3/users/a3e5b18af5a940d79ff270d9e6a56b7f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.840508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f7cf0f6a-ddb9-4c55-99fc-3881bbc5d899 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:37.841006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e5b18af5a940d79ff270d9e6a56b7f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:37.845162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f7cf0f6a-ddb9-4c55-99fc-3881bbc5d899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:37.845289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:37.852334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1091/2207] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:37.860738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.861048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.861345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.881947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:37.883198 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:37.891104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1092/2208] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:37.896036 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:37.906609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8db721-782f-4116-ba54-28e5f110eb7d None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:37.911870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:37.912538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.912822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.913150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.913885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:27:37.914347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:37.915950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:37.928965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1093/2209] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:27:37.933283 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:37.943192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d52698-339e-4df7-919d-900193ff96ec admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:37.947800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:37.948424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:37.948708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:37.949216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:37.949864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:37.951751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.043034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1094/2210] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:27:37 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:27:38.050104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.115364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699202ae-787a-4760-9f83-291b98d23caf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.119994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.120895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.121014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.121242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.121947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.124087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.144463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e5b18af5a940d79ff270d9e6a56b7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:38.254148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e5b18af5a940d79ff270d9e6a56b7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:38.262485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1095/2211] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:27:38 2022] POST /identity/v3/users => generated 289 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:27:38.274332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.274441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e5b18af5a940d79ff270d9e6a56b7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:38.274441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e5b18af5a940d79ff270d9e6a56b7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:38.276982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cef60-0b3a-4af8-96a8-86fc82b8746b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.279898 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e5b18af5a940d79ff270d9e6a56b7f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:38.283401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.284495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.284978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.285465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.286450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.288259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.295479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1117/2212] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:37 2022] DELETE /identity/v3/users/a3e5b18af5a940d79ff270d9e6a56b7f => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:27:38.300697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1096/2213] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:38.304184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.305682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:38.374968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba12b41-8904-427a-adff-df7494cbd1f0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.380454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.381222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.381515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.381794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.382533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.384132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d0228f-729a-4289-a6be-879afa85b48f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.394474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1118/2214] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:27:38.398818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.408658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f8ef2-87d6-44ce-aade-759e60309fb3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.413531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.414415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.414702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.414980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] PATH_INFO: `/v3/projects/2c74204853ea4dc88c06a2b74cdcf5bf/users/d16f97d139644ceab13368ee68b5d46c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.431916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c74204853ea4dc88c06a2b74cdcf5bf, user_id=d16f97d139644ceab13368ee68b5d46c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.434723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.617009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1097/2215] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:27:38 2022] PUT /identity/v3/projects/2c74204853ea4dc88c06a2b74cdcf5bf/users/d16f97d139644ceab13368ee68b5d46c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:38.619191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.619652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.620803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.654720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] MFA Rules not processed for user `d16f97d139644ceab13368ee68b5d46c`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:38.656098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:38.741223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1119/2216] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:27:38.748589 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.750383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:38.830836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de066e6-0a53-4074-b421-8ee32b40c087 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.835236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.835880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.836414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.836688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.845183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.846707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:38.855354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:38.856777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:38.858745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1098/2217] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:38.932029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a94e3-2b46-4dde-95c1-92c2d1e81352 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:38.937217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:38.941436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:38.941436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:38.941436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] PATH_INFO: `/v3/projects/330899ebdad84c2d9afebe1bc941a5e9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:38.941436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=330899ebdad84c2d9afebe1bc941a5e9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:38.943438 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:39.049418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '330899ebdad84c2d9afebe1bc941a5e9', 'request_id': 'req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.116550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '330899ebdad84c2d9afebe1bc941a5e9', 'request_id': 'req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.123500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '330899ebdad84c2d9afebe1bc941a5e9', 'request_id': 'req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.137124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] The token cache is being invalidate because project 330899ebdad84c2d9afebe1bc941a5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:39.137406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.138088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.139668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1120/2218] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:38 2022] DELETE /identity/v3/projects/330899ebdad84c2d9afebe1bc941a5e9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:39.144454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:39.155410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f6621-f2cf-49b0-8ad6-38a8584f9d05 service glance] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:39.212581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:39.213565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:39.213969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:39.214245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] PATH_INFO: `/v3/users/89884c78e9454ff19847803cc83d3541` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:39.215526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89884c78e9454ff19847803cc83d3541)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:39.217617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:39.357050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:39.495037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89884c78e9454ff19847803cc83d3541'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.790830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89884c78e9454ff19847803cc83d3541'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.791516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89884c78e9454ff19847803cc83d3541'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.804681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89884c78e9454ff19847803cc83d3541'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.811661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5d68f73f-b490-4f20-bbaa-117d5e1dabc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89884c78e9454ff19847803cc83d3541'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:39.818653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1099/2219] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:39 2022] DELETE /identity/v3/users/89884c78e9454ff19847803cc83d3541 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:39.854689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:40.255967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:40.259130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:40.274418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530322-9df0-4f85-a0a1-ed60b0db6ac7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:40.341685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:40.342678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:40.343023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:40.343363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] PATH_INFO: `/v3/projects/763b80567be946a4984a5297e37fdadd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:40.344634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763b80567be946a4984a5297e37fdadd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:40.347169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:40.490943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763b80567be946a4984a5297e37fdadd', 'request_id': 'req-26651934-f8ba-44a0-81b6-26591b964ca2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:40.572756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763b80567be946a4984a5297e37fdadd', 'request_id': 'req-26651934-f8ba-44a0-81b6-26591b964ca2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:40.582599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763b80567be946a4984a5297e37fdadd', 'request_id': 'req-26651934-f8ba-44a0-81b6-26591b964ca2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:40.591221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] The token cache is being invalidate because project 763b80567be946a4984a5297e37fdadd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:27:40.591510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:40.592175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:40.594027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1121/2220] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:40 2022] DELETE /identity/v3/projects/763b80567be946a4984a5297e37fdadd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:41.666146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:41.905167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:43.057102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:43.169012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:44.145936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:51.779473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b813e7-8bea-49ce-bbf9-f0164a03d1de None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:51.779983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b813e7-8bea-49ce-bbf9-f0164a03d1de None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:51.780303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b813e7-8bea-49ce-bbf9-f0164a03d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:51.798686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-62b813e7-8bea-49ce-bbf9-f0164a03d1de None None] MFA Rules not processed for user `71b891b8ddd648a29944dd04172a01d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:51.799888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-62b813e7-8bea-49ce-bbf9-f0164a03d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:51.858181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1100/2221] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:54.652357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=5,keystone:DELETE=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:58.659747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:58.661444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:58.728433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26651934-f8ba-44a0-81b6-26591b964ca2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:58.733268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:58.734201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:58.734482 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:58.734865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] PATH_INFO: `/v3/users/d16f97d139644ceab13368ee68b5d46c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:58.736065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16f97d139644ceab13368ee68b5d46c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:58.738072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:58.928992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16f97d139644ceab13368ee68b5d46c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:58.995824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16f97d139644ceab13368ee68b5d46c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.008977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16f97d139644ceab13368ee68b5d46c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.009760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16f97d139644ceab13368ee68b5d46c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.016876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16f97d139644ceab13368ee68b5d46c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.023428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1122/2222] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:27:58 2022] DELETE /identity/v3/users/d16f97d139644ceab13368ee68b5d46c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:27:59.027945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c784-5467-4635-b222-40512713bd43 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:59.028470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c784-5467-4635-b222-40512713bd43 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:59.028565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55c784-5467-4635-b222-40512713bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:59.046933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8d55c784-5467-4635-b222-40512713bd43 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:27:59.048235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8d55c784-5467-4635-b222-40512713bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:59.106975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1101/2223] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:27:59.117151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:59.118654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:59.177132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec864e60-8970-4e12-998b-396def8dba9b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:59.180451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:59.181128 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:59.181415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:59.181692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:59.190684 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:59.192143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956eb3b-851a-49d9-9d54-2b682c192279 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:59.202861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1123/2224] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:27:59.763106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c784-5467-4635-b222-40512713bd43 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:27:59.764899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8d55c784-5467-4635-b222-40512713bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:27:59.777704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55c784-5467-4635-b222-40512713bd43 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:27:59.782542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:27:59.783598 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:27:59.783882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:27:59.784160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] PATH_INFO: `/v3/projects/2c74204853ea4dc88c06a2b74cdcf5bf` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:27:59.785408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c74204853ea4dc88c06a2b74cdcf5bf)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:27:59.787357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:27:59.909482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:27:59.913422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c74204853ea4dc88c06a2b74cdcf5bf', 'request_id': 'req-c2320db5-2d90-4fc2-befd-7da066d1770c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.988987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c74204853ea4dc88c06a2b74cdcf5bf', 'request_id': 'req-c2320db5-2d90-4fc2-befd-7da066d1770c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:27:59.995701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c74204853ea4dc88c06a2b74cdcf5bf', 'request_id': 'req-c2320db5-2d90-4fc2-befd-7da066d1770c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:00.015485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] The token cache is being invalidate because project 2c74204853ea4dc88c06a2b74cdcf5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:28:00.015485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:00.015485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c2320db5-2d90-4fc2-befd-7da066d1770c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:00.015485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1102/2225] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:27:59 2022] DELETE /identity/v3/projects/2c74204853ea4dc88c06a2b74cdcf5bf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:28:00.019039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.019477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.019577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.039178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:00.040574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:00.058036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:00.103585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1124/2226] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:00.112572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.113171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.113171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.133457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:00.134676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:00.143477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1103/2227] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:00.148069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.160166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e84ed-7673-4663-a929-11f249f36e96 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.165162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.166116 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.166654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.166654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.167388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:28:00.167693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.169347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.187271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1125/2228] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:28:00.191683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.202288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde0362-76a3-4844-b24a-0988ca3eb8ac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.207188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.207898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.208226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.208501 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.209243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.211680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.288898 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1104/2229] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:28:00 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:28:00.293106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.303912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b997d4-e9a7-4d5b-9265-60c068294945 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.361461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.362139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.362424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.362700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.363415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.366014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.477940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1126/2230] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:28:00 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:28:00.481936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.492892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37209ee-c55b-4fc6-9abb-5ffb4177d5ab admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.497452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.498104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.498386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.498660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.499378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.500952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.514250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1105/2231] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:28:00.515604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.525977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33673a72-5140-4f3c-95a5-3e4f295c1063 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.530797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.531453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.531738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.532012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.532852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.534398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c35068-b39a-47cf-8d4f-cf6a466b5a90 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.548414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1127/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:28:00.549480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.560145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bc734-937b-47f2-8ab0-6f18b8e09164 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.565062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.565951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.566233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.566510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] PATH_INFO: `/v3/projects/042135bbb1784d25a1afb2e9a695621a/users/d638ec4b45af44ad9a26e24388241ae4/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.581390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042135bbb1784d25a1afb2e9a695621a, user_id=d638ec4b45af44ad9a26e24388241ae4, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.584255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.667667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1106/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:28:00 2022] PUT /identity/v3/projects/042135bbb1784d25a1afb2e9a695621a/users/d638ec4b45af44ad9a26e24388241ae4/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:28:00.679789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f40b3-1ef6-4ee5-9469-166ad3c12e80 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.681562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f40b3-1ef6-4ee5-9469-166ad3c12e80 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.681562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f40b3-1ef6-4ee5-9469-166ad3c12e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.714597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-679f40b3-1ef6-4ee5-9469-166ad3c12e80 None None] MFA Rules not processed for user `d638ec4b45af44ad9a26e24388241ae4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:00.715179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-679f40b3-1ef6-4ee5-9469-166ad3c12e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:00.797460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1128/2234] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:00.808987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:00.810731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:00.878352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a3444-8a32-4e9b-a1d4-73bad9968603 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:00.882290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:00.882989 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:00.883273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:00.883548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:00.892375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:00.894025 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:00.904326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1107/2235] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:01.474332 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3006b-e1bf-4f1f-b632-95bbed002f3b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:01.478297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3006b-e1bf-4f1f-b632-95bbed002f3b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:01.478297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3006b-e1bf-4f1f-b632-95bbed002f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:01.496352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c2d3006b-e1bf-4f1f-b632-95bbed002f3b None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:01.497624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c2d3006b-e1bf-4f1f-b632-95bbed002f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:01.512553 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.576962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1129/2236] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:01.634396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:01.639313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:01.755113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95714fad-15e2-4af0-a9b8-286c104f3ca9 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:01.761698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:01.762444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:01.762786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:01.763072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:01.781952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:01.783995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb5010-248d-4485-8008-a2b6f03189e4 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:01.791617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:01.796694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1108/2237] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:28:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:11.888814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=17 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:19.726809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:19.727466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:19.727466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:19.728864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1130/2238] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 07:28:19.753574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ff97b-8b88-4b34-af40-746c5491f1f5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:19.754508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ff97b-8b88-4b34-af40-746c5491f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:19.754960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ff97b-8b88-4b34-af40-746c5491f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:19.798225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-250ff97b-8b88-4b34-af40-746c5491f1f5 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:19.799626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-250ff97b-8b88-4b34-af40-746c5491f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:19.933782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1109/2239] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:28:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:19.945836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:19.947633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:20.016279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159cadb9-1d56-4c88-beb3-4351b00a44cc None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:20.019912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:20.020559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.020845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.021155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.031522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:20.032975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb5e05-ad89-4bf2-a469-c3298768a8b8 service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:20.044415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1131/2240] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:20.215720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.216008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.216287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.217726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1110/2241] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:28:20.222570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fc9-0fd0-4f62-b087-3ed2a3e561aa None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.222905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fc9-0fd0-4f62-b087-3ed2a3e561aa None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.223193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0325fc9-0fd0-4f62-b087-3ed2a3e561aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.252806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d0325fc9-0fd0-4f62-b087-3ed2a3e561aa None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:20.254707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d0325fc9-0fd0-4f62-b087-3ed2a3e561aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:20.308858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1132/2242] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:20.321387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:20.323106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:20.340009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0f25a-d7e8-42c3-a73a-e3a9bec0def2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:20.343843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:20.345109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.345401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.345676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.353065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:20.354516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d05b73-df56-440f-93e7-daac81485c04 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:20.362347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1111/2243] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:20.449524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1a40-3243-475e-97b9-ad219a89c5a4 None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.449815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1a40-3243-475e-97b9-ad219a89c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.450096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1a40-3243-475e-97b9-ad219a89c5a4 None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.451488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1133/2244] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:28:20.456755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a840-8560-44dd-8597-0980b465b721 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.457066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a840-8560-44dd-8597-0980b465b721 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.457494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783a840-8560-44dd-8597-0980b465b721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.482731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1783a840-8560-44dd-8597-0980b465b721 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:20.482731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1783a840-8560-44dd-8597-0980b465b721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:20.492104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1112/2245] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:20.502850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1a40-3243-475e-97b9-ad219a89c5a4 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:20.515226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c1a40-3243-475e-97b9-ad219a89c5a4 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:20.519041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:20.519776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.520060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.520333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.530968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:20.532498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:20.543845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1134/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:20.872305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d292a9-fb07-441b-a2db-0f0fe2935cd0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:20.872796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d292a9-fb07-441b-a2db-0f0fe2935cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:20.872877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d292a9-fb07-441b-a2db-0f0fe2935cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:20.892949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f4d292a9-fb07-441b-a2db-0f0fe2935cd0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:20.894573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f4d292a9-fb07-441b-a2db-0f0fe2935cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:20.998439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1113/2247] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:21.061938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:21.063552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:21.079175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea84e-3f9e-46b6-a96f-9d9c2e7323d1 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:21.085513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:21.086156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:21.086693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:21.086971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:21.095659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:21.097272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:21.107675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1135/2248] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:27.292770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76104c-a436-4747-8095-20244fcb986e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:27.293338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76104c-a436-4747-8095-20244fcb986e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:27.293432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76104c-a436-4747-8095-20244fcb986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:27.311367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1c76104c-a436-4747-8095-20244fcb986e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:27.312555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1c76104c-a436-4747-8095-20244fcb986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:27.320410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1114/2249] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:27.355234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:27.366417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36bbc65-1e96-4234-97b6-d3aa88d295de service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:27.372632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:27.373210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:27.373498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:27.373781 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:27.382367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:27.384455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:27.394480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1136/2250] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:27.628521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:27.628836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:27.629184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:27.648023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:27.649261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:27.657109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1115/2251] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:28:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:27.669297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:27.680582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac833ddb-bfbf-46eb-baf9-743a00a32d75 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:27.685947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:27.686634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:27.686916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:27.687193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:27.695818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:27.697953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12878d62-bd2b-4dc9-a796-6b7160cafbb3 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:27.705925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1137/2252] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:28:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:37.642445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=73 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:37.702623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=73 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:44.158792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:44.170620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccceea7-8293-4ddd-a310-6af29f121d49 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:44.175071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:44.175933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:44.176211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:44.176484 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] PATH_INFO: `/v3/users/d638ec4b45af44ad9a26e24388241ae4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:44.177675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d638ec4b45af44ad9a26e24388241ae4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:44.179572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:44.344040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd638ec4b45af44ad9a26e24388241ae4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:44.412111 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd638ec4b45af44ad9a26e24388241ae4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:44.412777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd638ec4b45af44ad9a26e24388241ae4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:44.426813 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd638ec4b45af44ad9a26e24388241ae4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:44.434469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd638ec4b45af44ad9a26e24388241ae4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:44.440732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1116/2253] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:28:44 2022] DELETE /identity/v3/users/d638ec4b45af44ad9a26e24388241ae4 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:28:44.445551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:44.446055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:44.446159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:44.464354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:44.465591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:44.527214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1138/2254] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:44.536003 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:44.537433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:44.594841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0437afb9-18ee-40a4-a4e9-30ea7dbdc380 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:44.598601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:44.599250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:44.599534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:44.599812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:44.609741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:44.611163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5351eef-f69b-4485-9c4f-f52326f15d26 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:44.620619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1117/2255] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:45.023123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.024508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:45.044096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a45c4d-884c-4cfb-afc3-057587ae36ea None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.049480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.050355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.050637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.050909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] PATH_INFO: `/v3/projects/042135bbb1784d25a1afb2e9a695621a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.052126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=042135bbb1784d25a1afb2e9a695621a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.054208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.204340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042135bbb1784d25a1afb2e9a695621a', 'request_id': 'req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:45.257702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042135bbb1784d25a1afb2e9a695621a', 'request_id': 'req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:45.264062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042135bbb1784d25a1afb2e9a695621a', 'request_id': 'req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:45.274560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] The token cache is being invalidate because project 042135bbb1784d25a1afb2e9a695621a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:28:45.274853 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:45.275477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6b290f42-6c7d-4e80-b522-8d0684b5a0ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:45.277796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1139/2256] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:28:45 2022] DELETE /identity/v3/projects/042135bbb1784d25a1afb2e9a695621a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:28:45.287769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.288255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.288348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.306324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:45.307590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:45.371783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1118/2257] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:45.380810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.381131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.381414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.400433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:45.402707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:45.410851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1140/2258] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:45.414953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.427695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e020606-c2bf-47e7-bc01-384524e8f6a6 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.434806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.435850 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.436319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.436768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.438028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:28:45.438540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.441355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.455612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1119/2259] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:28:45.460140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.470343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c840b6-de1d-4b13-b75d-0b8a19013412 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.475059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.475790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.476078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.476356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.477077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.478967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.575016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1141/2260] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:28:45 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:28:45.579300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.584715 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:45.591661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109cfb6-5be5-4aea-82e3-98f9134d7348 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.679417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.680165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.680455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.680736 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.682141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.684864 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.790121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1120/2261] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:28:45 2022] POST /identity/v3/users => generated 286 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:28:45.794662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.806665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03a6a85-93a7-4286-9e12-0ae15538c75c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.812464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.813366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.813658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.813935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.814685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.816300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.834148 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1142/2262] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:28:45.837903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.849353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49615e4d-9131-4551-9497-7bc19fd15be4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.855433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.856124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.856487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.857109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.858085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.860082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1c6fe-8b47-4d2e-a581-7c0c979fbf87 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:45.878000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1121/2263] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:28:45.882661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:45.894887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab1407-ae4c-4175-94f4-9e181b4817a8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:45.899731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:45.900771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:45.901261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:45.901591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] PATH_INFO: `/v3/projects/4b50492d417e42b2ab51dbe734b0093a/users/e4ffc0ed077b4752ad327ba59a82e53b/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:45.919347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b50492d417e42b2ab51dbe734b0093a, user_id=e4ffc0ed077b4752ad327ba59a82e53b, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:45.922156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:46.018563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1143/2264] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:28:45 2022] PUT /identity/v3/projects/4b50492d417e42b2ab51dbe734b0093a/users/e4ffc0ed077b4752ad327ba59a82e53b/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:28:46.030318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.030621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.031372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.057798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] MFA Rules not processed for user `e4ffc0ed077b4752ad327ba59a82e53b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:46.059627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.127381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1122/2265] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:46.140072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:46.141816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.164181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:46.198873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f42e7-243d-44c1-a30f-1aa20f6ebc9b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:46.202534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:46.203205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.203492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.203772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.212246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:46.213794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c1579-79b7-4511-9c7f-baf53ecedb78 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:46.224656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1144/2266] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:46.249592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:46.304941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.305193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.305475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.312713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d01d9d-071e-4e87-a730-aa4639d33d99 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:46.317468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:46.318345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.318759 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.319041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] PATH_INFO: `/v3/users/e4ffc0ed077b4752ad327ba59a82e53b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.320308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ffc0ed077b4752ad327ba59a82e53b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:46.322270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:46.325767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:46.327305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.336094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1145/2267] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:28:46.336251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:46.358688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:46.360088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.433355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d252b-34ae-4ed8-b6c1-90e73669d7c7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:46.439059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:46.439698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.439979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.440249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.449057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:46.450633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a9e3-0ee9-423b-af2a-07f93b0ebc8d service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:46.460115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1146/2268] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:28:46.532948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ffc0ed077b4752ad327ba59a82e53b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:46.610551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ffc0ed077b4752ad327ba59a82e53b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:46.611113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ffc0ed077b4752ad327ba59a82e53b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:46.624401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ffc0ed077b4752ad327ba59a82e53b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:46.631354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ffc0ed077b4752ad327ba59a82e53b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:46.638355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1123/2269] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:28:46 2022] DELETE /identity/v3/users/e4ffc0ed077b4752ad327ba59a82e53b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:28:46.643171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.643623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.649134 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.662210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:46.663511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.724810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1147/2270] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:46.735284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:46.736721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:46.794413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f6ab1-25e4-4fe2-b56e-8bcfb313b4bf admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:46.798132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:46.798782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:46.799065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:46.799338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:46.808959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:46.810417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b7fe3-5574-4c1b-bd99-0a9b12cef70b service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:46.819867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1124/2271] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:47.259498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:47.261125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:47.274605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd1615-60dc-4c42-8b74-e51f65d4332c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:47.280011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:47.280872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:47.281194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:47.281471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] PATH_INFO: `/v3/projects/4b50492d417e42b2ab51dbe734b0093a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:47.282668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b50492d417e42b2ab51dbe734b0093a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:47.284560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:47.392683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:47.402018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b50492d417e42b2ab51dbe734b0093a', 'request_id': 'req-efd4b778-2e7f-4040-81dc-b121f3924b87'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:47.513102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b50492d417e42b2ab51dbe734b0093a', 'request_id': 'req-efd4b778-2e7f-4040-81dc-b121f3924b87'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:47.519838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b50492d417e42b2ab51dbe734b0093a', 'request_id': 'req-efd4b778-2e7f-4040-81dc-b121f3924b87'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:47.530526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] The token cache is being invalidate because project 4b50492d417e42b2ab51dbe734b0093a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:28:47.530953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:47.531906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:28:47.533624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1148/2272] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:28:47 2022] DELETE /identity/v3/projects/4b50492d417e42b2ab51dbe734b0093a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:28:50.160455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa327-ba89-45e2-b7c6-33e654f119fd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:50.161041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa327-ba89-45e2-b7c6-33e654f119fd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:50.161041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aaa327-ba89-45e2-b7c6-33e654f119fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:50.180418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e0aaa327-ba89-45e2-b7c6-33e654f119fd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:50.181749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e0aaa327-ba89-45e2-b7c6-33e654f119fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:50.245740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1125/2273] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:50.273231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:50.274738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:50.374788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4b778-2e7f-4040-81dc-b121f3924b87 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:50.380697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:50.381401 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:50.381691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:50.382269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:50.391274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:50.392929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:50.403495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1149/2274] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:28:53.066969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ab88-a086-4817-903a-34d30bc247ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:53.067453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ab88-a086-4817-903a-34d30bc247ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:53.067534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6ab88-a086-4817-903a-34d30bc247ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:53.087107 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e5c6ab88-a086-4817-903a-34d30bc247ff None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:53.088325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e5c6ab88-a086-4817-903a-34d30bc247ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:53.121345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:28:53.153182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1126/2275] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:28:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:53.161907 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:53.163385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:53.244080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f6db0-60a0-4893-b151-11543e80bb45 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:53.249698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:53.250338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:53.250619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:53.251119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:53.259007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:53.260595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:53.269457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1150/2276] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:28:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:28:56.593432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9ca0-c83b-4c0b-b401-9948f0956379 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:56.593949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9ca0-c83b-4c0b-b401-9948f0956379 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:56.594040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be9ca0-c83b-4c0b-b401-9948f0956379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:56.612298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a7be9ca0-c83b-4c0b-b401-9948f0956379 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:28:56.613707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a7be9ca0-c83b-4c0b-b401-9948f0956379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:28:56.621644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1127/2277] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:28:56.656301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:28:56.668455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d6a374-5df0-4500-91a8-707f2fd49ee4 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:28:56.674168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:28:56.674904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:28:56.675275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:28:56.675614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:28:56.684215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:28:56.685891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:28:56.696304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1151/2278] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:02.942839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afea82-f3e6-4b57-8e02-39cc3f128077 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:02.943434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afea82-f3e6-4b57-8e02-39cc3f128077 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:02.943546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69afea82-f3e6-4b57-8e02-39cc3f128077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:02.971932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-69afea82-f3e6-4b57-8e02-39cc3f128077 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:02.973502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-69afea82-f3e6-4b57-8e02-39cc3f128077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:02.982787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1128/2279] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:29:03.013875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:03.025486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb6c05-de98-4bd5-992b-7164d307141e service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:03.031807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:03.032466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:03.032748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:03.033038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:03.042244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:03.043857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:03.054616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1152/2280] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:03.188051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ca66-6527-4c45-9c60-15d92a10079f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:03.188332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ca66-6527-4c45-9c60-15d92a10079f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:03.188608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095ca66-6527-4c45-9c60-15d92a10079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:03.207396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a095ca66-6527-4c45-9c60-15d92a10079f None None] MFA Rules not processed for user `6ebf13c104564589a51fa45f8c1e6126`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:03.209410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a095ca66-6527-4c45-9c60-15d92a10079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:03.268282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1129/2281] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:29:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:13.049785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:29:13.260962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=41 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:29:17.840852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:17.842527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:17.914936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f4361-de5b-490c-ad15-425be81d8c74 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:17.920203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:17.921449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:17.921779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:17.922058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:17.924310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:17.943581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:17.945814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57d8dd5-22be-4690-ba0b-4f8b08cf7e5a service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:17.969178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1153/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:25.709608 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6f79-4d4b-4327-bf54-847b2e238920 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:25.710076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6f79-4d4b-4327-bf54-847b2e238920 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:25.710169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52b6f79-4d4b-4327-bf54-847b2e238920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:25.727766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b52b6f79-4d4b-4327-bf54-847b2e238920 None None] MFA Rules not processed for user `7497393918164e09ae6354906d783729`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:25.728981 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b52b6f79-4d4b-4327-bf54-847b2e238920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:25.782331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1130/2283] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:29:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:27.955956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=32 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:29:34.272728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:34.273383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:34.273383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:34.294807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] MFA Rules not processed for user `71b891b8ddd648a29944dd04172a01d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:34.294807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:34.346943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1154/2284] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:29:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:35.775812 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=25 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:29:44.339360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=25 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:29:46.706028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d209-fbee-4084-ac5c-240fc003b124 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:46.706514 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d209-fbee-4084-ac5c-240fc003b124 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:46.706619 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684d209-fbee-4084-ac5c-240fc003b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:46.727410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0684d209-fbee-4084-ac5c-240fc003b124 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:46.732102 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0684d209-fbee-4084-ac5c-240fc003b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:46.737804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1131/2285] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:46.759068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:46.761231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:46.778591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3857-6cd3-45f0-af6e-067e9266bbe2 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:46.785703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:46.786384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:46.786670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:46.787162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:46.797699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:46.800119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c9a01c-2615-4b82-9006-d5b9f75473ee service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:46.811023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1155/2286] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:50.097384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:50.097915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:50.098012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:50.116389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] MFA Rules not processed for user `858da270173c4944ab3c7829bd698c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:50.117638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:50.172837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1132/2287] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:29:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:50.246061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809953dc-68db-4482-8515-c1026ee1bc97 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:50.246714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809953dc-68db-4482-8515-c1026ee1bc97 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:50.246714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809953dc-68db-4482-8515-c1026ee1bc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:50.269320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-809953dc-68db-4482-8515-c1026ee1bc97 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:50.270710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-809953dc-68db-4482-8515-c1026ee1bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:50.280823 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1156/2288] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:50.403106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:50.416959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece757bd-166c-4b40-8571-e62077ceaaad None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:50.422987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:50.423661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:50.424014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:50.424363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:50.433221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:50.434854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:50.445800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1133/2289] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:54.111093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcdd1-afd5-4bec-827b-c3438fdc3d79 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:54.111790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcdd1-afd5-4bec-827b-c3438fdc3d79 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:54.112017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fbcdd1-afd5-4bec-827b-c3438fdc3d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:54.133102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-58fbcdd1-afd5-4bec-827b-c3438fdc3d79 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:54.134502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-58fbcdd1-afd5-4bec-827b-c3438fdc3d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:54.147852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1157/2290] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:54.179118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:54.190158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f047ff-3f20-4a98-84ac-83ed038ab643 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:54.195592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:54.196236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:54.196520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:54.196797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:54.206130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:54.207694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:54.217848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1134/2291] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:29:58.355665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5745-5e0f-494e-82e6-8a51968bf61c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:58.356154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5745-5e0f-494e-82e6-8a51968bf61c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:58.356268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e5745-5e0f-494e-82e6-8a51968bf61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:58.374494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a01e5745-5e0f-494e-82e6-8a51968bf61c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:29:58.375674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a01e5745-5e0f-494e-82e6-8a51968bf61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:29:58.383679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1158/2292] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:29:58.413170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:29:58.424977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228e2e8-4e82-4af2-943a-5da3df0caf9d service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:29:58.430467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:29:58.431098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:29:58.431401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:29:58.431660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:29:58.439994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:29:58.441599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:29:58.450881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1135/2293] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:30:02.638490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7560d-e005-4a22-bda9-ae2cf3841dcd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:02.638490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7560d-e005-4a22-bda9-ae2cf3841dcd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:02.638490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7560d-e005-4a22-bda9-ae2cf3841dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:02.638490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-fed7560d-e005-4a22-bda9-ae2cf3841dcd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:30:02.639807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fed7560d-e005-4a22-bda9-ae2cf3841dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:02.649358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1159/2294] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Jul 12 07:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:30:02.678907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:30:02.691110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86df49f-4cd6-4081-bf72-f7ac1a247ca5 service nova] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:30:02.697121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:30:02.697848 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:02.698204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:02.698553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:02.708145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:30:02.709841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccb262-e099-40b8-a9b6-551f370fef0d service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:30:02.721705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1136/2295] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:30:12.633294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=18 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:30:12.716613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=52 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:30:21.634742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:21.635431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:21.635555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:21.653420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] MFA Rules not processed for user `eaea1f637c35454bb2ac75c2eefc26d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:30:21.654695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:21.712099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1160/2296] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:30:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:30:31.704546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=25 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:30:38.267654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108a26b-4294-445e-9225-a104af149f06 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:38.269328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108a26b-4294-445e-9225-a104af149f06 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:38.269328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108a26b-4294-445e-9225-a104af149f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:38.286606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1108a26b-4294-445e-9225-a104af149f06 None None] MFA Rules not processed for user `6ebf13c104564589a51fa45f8c1e6126`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:30:38.288018 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1108a26b-4294-445e-9225-a104af149f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:38.294997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1137/2297] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:30:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:30:39.477764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:30:39.479789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:39.498946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554ed8-4473-47d0-8d5e-75594efdbc91 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:30:39.500671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:30:39.501632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:39.501916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:39.502267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] PATH_INFO: `/v3/users/7497393918164e09ae6354906d783729` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:39.504164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7497393918164e09ae6354906d783729)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:30:39.506261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:30:39.687089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7497393918164e09ae6354906d783729'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:39.771637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7497393918164e09ae6354906d783729'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:39.790754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7497393918164e09ae6354906d783729'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:39.791519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7497393918164e09ae6354906d783729'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:39.798792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1766c6ec-ef25-4810-872f-b55e392f21f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7497393918164e09ae6354906d783729'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:39.805810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1161/2298] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:30:39 2022] DELETE /identity/v3/users/7497393918164e09ae6354906d783729 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:30:40.186463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108a26b-4294-445e-9225-a104af149f06 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:30:40.199602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108a26b-4294-445e-9225-a104af149f06 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:30:40.265434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:30:40.266365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:40.266652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:40.266925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] PATH_INFO: `/v3/projects/8a0d3e91110d42f1925878d532f4ac9d` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:40.268128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a0d3e91110d42f1925878d532f4ac9d)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:30:40.270157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:30:40.379617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a0d3e91110d42f1925878d532f4ac9d', 'request_id': 'req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:40.447650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a0d3e91110d42f1925878d532f4ac9d', 'request_id': 'req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:40.458677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a0d3e91110d42f1925878d532f4ac9d', 'request_id': 'req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:40.464845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] The token cache is being invalidate because project 8a0d3e91110d42f1925878d532f4ac9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:30:40.465176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:40.465807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:30:40.467395 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1138/2299] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:30:40 2022] DELETE /identity/v3/projects/8a0d3e91110d42f1925878d532f4ac9d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:30:49.801863 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:30:50.461457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:30:54.386641 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:54.387295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:54.387295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:54.406222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] MFA Rules not processed for user `71b891b8ddd648a29944dd04172a01d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:30:54.407431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:54.466464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1162/2300] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:30:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:30:55.175454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:30:55.177100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:55.243426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb8a4f-ff1f-4d17-806c-73783b7b5cd8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:30:55.247078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:30:55.247732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:55.248015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:55.248506 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:55.250740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:55.345451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:30:55.347650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:30:55.359346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1139/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:30:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:30:56.354395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:30:56.355950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:56.371449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69317d6c-42f3-46d0-b7fb-eb1be0d87aba None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:30:56.375363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:30:56.376024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:30:56.378451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:30:56.378451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:30:56.379296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:30:56.395731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:30:56.397221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f0d2a-4fb9-4f57-adcf-0a3551256199 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:30:56.408725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1163/2302] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:30:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:05.354822 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=54 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:06.403545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=31 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:09.654336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:09.663716 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a25e1-bf18-427a-ac05-6567e715197b service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:09.667386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:09.668027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:09.668308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:09.668584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:09.670518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:09.730153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:09.731597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:09.740683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1140/2303] 10.222.0.27 () {60 vars in 1396 bytes} [Tue Jul 12 07:31:09 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:12.342455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:12.348079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:12.348079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:12.360788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:12.362042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:12.418611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1164/2304] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:31:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:12.548499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:12.550857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:12.624779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dce4c9-cf4d-4a49-8a3f-e1d3cac03749 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:12.630475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:12.631244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:12.631533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:12.631806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:12.640118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:12.641780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af1c15-0f3f-422d-bb99-de039070f4bc service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:12.650106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1141/2305] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:31:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:31:20.569675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:20.571221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:20.592897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad3ba2-669c-4e67-b07b-8634338f6cdd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:20.599108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:20.599768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:20.600053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:20.600329 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:20.602256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:20.710246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:20.711862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2252556-1dae-4f5d-8fd6-c96e0c2cad69 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:20.725173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1165/2306] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:31:22.646873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=60 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:30.717452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=53 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:32.315742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.316595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.317017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.318444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1142/2307] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:31:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:31:32.324378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869498-df6a-40cf-a54d-ca52f66c92f3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.324821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869498-df6a-40cf-a54d-ca52f66c92f3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.324952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92869498-df6a-40cf-a54d-ca52f66c92f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.344768 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-92869498-df6a-40cf-a54d-ca52f66c92f3 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:32.346183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-92869498-df6a-40cf-a54d-ca52f66c92f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:32.356708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1166/2308] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:31:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:32.368827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:32.370757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:32.429272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f793b-24eb-4220-a7d0-ba0a0fb68065 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:32.432789 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:32.433453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.433737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.434013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.444068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:32.445511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e793b-fd76-46a4-89e6-2dcb31ae0d4c service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:32.456991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1143/2309] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:32.657738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77b68-425f-4f86-8c5c-e6a001d5c59b None None] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.657938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77b68-425f-4f86-8c5c-e6a001d5c59b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.658245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a77b68-425f-4f86-8c5c-e6a001d5c59b None None] PATH_INFO: `/` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.659671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1167/2310] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:31:32.664422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa786e-4fb2-4b21-94ce-ffa759726bd9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.664719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa786e-4fb2-4b21-94ce-ffa759726bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.665065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa786e-4fb2-4b21-94ce-ffa759726bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.684558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-affa786e-4fb2-4b21-94ce-ffa759726bd9 None None] MFA Rules not processed for user `13212d1708cc4c00867ebf6d713559d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:32.685858 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-affa786e-4fb2-4b21-94ce-ffa759726bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:32.693434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1144/2311] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:31:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:32.705392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77b68-425f-4f86-8c5c-e6a001d5c59b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:32.716398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a77b68-425f-4f86-8c5c-e6a001d5c59b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:32.719968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:32.720600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.720878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.721198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.728135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:32.729713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f16f6-9e78-4f33-8755-7f5930bca3dd service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:32.738171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1168/2312] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:32.825879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e3c0-a4a8-4e0a-8c72-a9e82dd4f4d4 None None] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.826304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e3c0-a4a8-4e0a-8c72-a9e82dd4f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.826454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5e3c0-a4a8-4e0a-8c72-a9e82dd4f4d4 None None] PATH_INFO: `/` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.828052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1145/2313] 10.222.0.27 () {54 vars in 921 bytes} [Tue Jul 12 07:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 07:31:32.833750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.834037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.834314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.852877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] MFA Rules not processed for user `1bd3f89d420e4418babdbac8736d8fa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:32.854092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:32.863969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1169/2314] 10.222.0.27 () {58 vars in 1018 bytes} [Tue Jul 12 07:31:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:32.874638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e3c0-a4a8-4e0a-8c72-a9e82dd4f4d4 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:32.885685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5e3c0-a4a8-4e0a-8c72-a9e82dd4f4d4 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:32.889270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:32.889897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:32.890176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:32.890449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:32.901436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:32.902843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:32.914572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1146/2315] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:32.983096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:32.984561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:33.057447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc12be-48a4-435c-a9f1-de43cfd705c8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:33.062603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:33.063248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:33.063528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:33.063829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:33.066207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:33.077423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:33.078993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd7b4-09ab-455d-97b5-af6018ffe12b service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:33.089559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1170/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:34.646350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:34.655301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5f622-0699-4b61-bd1a-f478dac7c2cc service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:34.659112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:34.659788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:34.660078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:34.660517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:34.664154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:34.674450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:34.676387 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:34.685200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1147/2317] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:36.553773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:36.554305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:36.554305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:36.572375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:36.573627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:36.580790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1171/2318] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:31:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:36.593697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:36.612462 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59484b82-d3f3-40aa-85e1-4538209c72fa service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:36.627313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:36.628083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:36.629123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:36.629513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:36.638650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:36.640212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:36.648913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1148/2319] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:31:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:31:46.567187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=47 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:46.645436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=47 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:31:48.513319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:48.526537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a4c28-74dc-44d7-98e6-df488e2c0c7e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:48.532189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:48.532835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:48.533164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:48.533449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:48.535396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:48.547720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:48.549588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:48.561389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1172/2320] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:50.695304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:50.708884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677575cf-de85-4bb2-95a1-de3b1a2c4bb7 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:50.715371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:50.716068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:50.716383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:50.716701 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:50.718593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:50.738014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:50.740235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b730074d-f685-4dca-a17c-22eb29736ca8 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:50.751082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1149/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:52.641451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:52.653367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362632f1-d1a5-48a3-9d61-ef5b751eadb8 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:52.659158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:52.659811 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:52.660102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:52.660376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:52.662225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:52.672841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:52.674455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:52.684081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1173/2322] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:31:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:31:55.350545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:55.351056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:55.351203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:55.369391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:31:55.370646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:31:55.378695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1150/2323] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:31:55.391030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:31:55.408022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c8e21-4624-4c91-9423-9e6dfa2cea5e service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:31:55.408022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:31:55.408388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:31:55.408667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:31:55.408937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:31:55.417663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:31:55.419225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:31:55.427288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1174/2324] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:32:03.359077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:03.360487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:03.375581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a7bdd-9b99-42c5-8a08-690f6749667c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:03.382261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:03.383265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:03.383265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:03.383490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:03.385354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:03.397772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:03.399431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:03.410166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1151/2325] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:03.509648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:03.511146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:03.583364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5a48d-9edb-4901-814d-765617cad701 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:03.588012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:03.589184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:03.589466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:03.589741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] PATH_INFO: `/v3/users/6ebf13c104564589a51fa45f8c1e6126` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:03.590935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ebf13c104564589a51fa45f8c1e6126)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:03.592857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:03.767655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ebf13c104564589a51fa45f8c1e6126'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:03.843877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ebf13c104564589a51fa45f8c1e6126'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:03.856593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ebf13c104564589a51fa45f8c1e6126'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:03.857259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ebf13c104564589a51fa45f8c1e6126'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:03.865222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1bc79e16-735e-4e0e-a835-ef8e81b0cc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ebf13c104564589a51fa45f8c1e6126'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:03.871388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1175/2326] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:03 2022] DELETE /identity/v3/users/6ebf13c104564589a51fa45f8c1e6126 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:04.133523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.146093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfff3-e599-4090-bc13-7db7e009babc service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.209959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.210868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.211149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.211421 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] PATH_INFO: `/v3/projects/33d41c90c5d84426adb80aa141d3b794` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.212643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d41c90c5d84426adb80aa141d3b794)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.214967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.320437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d41c90c5d84426adb80aa141d3b794', 'request_id': 'req-4ef88999-ed08-4554-a30e-0a4f46fe6551'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:04.411017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d41c90c5d84426adb80aa141d3b794', 'request_id': 'req-4ef88999-ed08-4554-a30e-0a4f46fe6551'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:04.417157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d41c90c5d84426adb80aa141d3b794', 'request_id': 'req-4ef88999-ed08-4554-a30e-0a4f46fe6551'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:04.429077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] The token cache is being invalidate because project 33d41c90c5d84426adb80aa141d3b794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:04.429367 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:04.429997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-4ef88999-ed08-4554-a30e-0a4f46fe6551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:04.431528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1152/2327] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:04 2022] DELETE /identity/v3/projects/33d41c90c5d84426adb80aa141d3b794 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:04.436459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.436850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.437179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.457732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:04.459090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:04.494227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:04.519884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1176/2328] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:04.528038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.528331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.528611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.547348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:04.548671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:04.557232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1153/2329] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:04.561447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.570943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c44f4-7258-4cd2-a360-f83815cc5e17 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.575578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.576222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.576511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.576786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.577575 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:04.577882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.579484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.593073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1177/2330] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:04.597971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.607146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59e111-747d-41f9-800b-e0cbe892aac2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.612013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.612678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.613564 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.613873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.614939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.616847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.726807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1154/2331] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:04 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:04.731066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.746419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd20a-659b-44f6-a14b-81082c46a0d6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.808645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.809485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.809987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.810317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.811215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.814090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.894742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1178/2332] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:04 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:04.896112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.908338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793508b-a998-4010-8ba1-da7b359e6b93 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.916873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.916873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.916873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.916873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.917425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.917679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.931384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1155/2333] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:04.932583 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.943139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea7f9-2e16-454b-996c-db971b235bee admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.947871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.952940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.952940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.952940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:04.952940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:04.952940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c71929-ae55-4b56-ab05-929a3083d78e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:04.962910 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1179/2334] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:04.972691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:04.983170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce9abc-03b3-4c48-97a2-e4b098978907 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:04.988034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:04.988926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:04.989258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:04.989527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] PATH_INFO: `/v3/projects/8030faed4d9945b5a6f948b931ca1d8d/users/4d0be2093df94728a7e830bc309bbf1a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.005901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8030faed4d9945b5a6f948b931ca1d8d, user_id=4d0be2093df94728a7e830bc309bbf1a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.008595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.011098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:05.116222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1156/2335] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:04 2022] PUT /identity/v3/projects/8030faed4d9945b5a6f948b931ca1d8d/users/4d0be2093df94728a7e830bc309bbf1a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:05.126215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.126573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.126899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.154855 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] MFA Rules not processed for user `4d0be2093df94728a7e830bc309bbf1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:05.156126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:05.228364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1180/2336] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:05.232943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.307314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79969661-1683-45cf-9b89-6d8fae357d60 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.312703 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.313725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.314113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.314570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.315684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.318009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.478088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1157/2337] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:05 2022] POST /identity/v3/projects => generated 383 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:05.482228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.493467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584099f2-1957-4d4b-94a8-e5998bc8fdd7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.530088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:05.555149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.558598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.558598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.558598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.558598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.559458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.642254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1181/2338] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:05 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:05.646532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.663583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41103e1-5fa7-4014-8330-3f374a91ee5e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.669624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.670315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.670605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.670889 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.671637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.673364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.687097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1158/2339] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:05.691410 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.703166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f9348-3623-48be-b836-fd5dea6ac1c6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.713531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.714713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.714976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.715245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] PATH_INFO: `/v3/projects/e42063b9b3fa437ab379694f2de566ba/users/94ff9fa15c9a4401b54168af281eee2f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.733801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42063b9b3fa437ab379694f2de566ba, user_id=94ff9fa15c9a4401b54168af281eee2f, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.736415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.806772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1182/2340] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:05 2022] PUT /identity/v3/projects/e42063b9b3fa437ab379694f2de566ba/users/94ff9fa15c9a4401b54168af281eee2f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:05.814238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.833199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069d7bf-7589-4b58-888e-c824aa975846 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.923719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.924405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.924765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.924953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.926019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.927720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c2709-abfd-40cb-8a04-319a71aafa36 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:05.948448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1159/2341] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:05.957596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:05.971221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3daf4c6-7b04-4168-8f69-eed2772d4465 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:05.979700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:05.982867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:05.982867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:05.982867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] PATH_INFO: `/v3/projects/e42063b9b3fa437ab379694f2de566ba/users/94ff9fa15c9a4401b54168af281eee2f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:05.983435 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e42063b9b3fa437ab379694f2de566ba, user_id=94ff9fa15c9a4401b54168af281eee2f, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:05.988139 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:06.000640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1183/2342] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:05 2022] PUT /identity/v3/projects/e42063b9b3fa437ab379694f2de566ba/users/94ff9fa15c9a4401b54168af281eee2f/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:06.011012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:06.011592 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:06.012151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:06.045485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] MFA Rules not processed for user `94ff9fa15c9a4401b54168af281eee2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:06.046721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:06.101917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:06.121460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1160/2343] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:06.133101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:06.134969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:06.203062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea245bb6-eed9-44a1-aa42-e05c96aaee3d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:06.207869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:06.208532 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:06.208824 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:06.209138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:06.225195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:06.227476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:06.244387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1184/2344] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:06.355165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:06.356774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:06.368836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6d3d0-a4de-4444-953c-2df553fa1db8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:06.372442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:06.373133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:06.373415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:06.373686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:06.434210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:06.435648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:06.445643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1161/2345] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:07.394880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:07.396274 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:07.454284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca9e96-8cac-4aae-8933-f4c65f3cd3bc service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:07.458441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:07.459085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:07.459363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:07.459634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:07.461484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:07.507290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:07.526563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:07.528008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec3e36-0695-4672-b539-03aaee398c96 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:07.538765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1185/2346] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:09.665835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:09.678962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9ecd-cb84-4840-91b4-ec2edc794a9c service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:09.683744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:09.684613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:09.684896 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:09.685210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] PATH_INFO: `/v3/users/4d0be2093df94728a7e830bc309bbf1a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:09.686397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0be2093df94728a7e830bc309bbf1a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:09.688710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:09.883731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0be2093df94728a7e830bc309bbf1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:09.954429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0be2093df94728a7e830bc309bbf1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:09.955194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0be2093df94728a7e830bc309bbf1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:09.975884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0be2093df94728a7e830bc309bbf1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:09.983478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0be2093df94728a7e830bc309bbf1a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:09.991139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1162/2347] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:09 2022] DELETE /identity/v3/users/4d0be2093df94728a7e830bc309bbf1a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:09.995816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:09.996242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:09.996358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:10.014802 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:10.016023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:10.099082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1186/2348] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:10.109242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:10.110718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:10.173751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78018486-e097-4dca-981e-ea0110da4741 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:10.178245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:10.178969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:10.179325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:10.179693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:10.189786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:10.192010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:10.202708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1163/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:10.700259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:10.701876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:10.724664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55619039-23f9-4df6-8ae1-de9c2d04af73 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:10.731421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:10.732775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:10.733350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:10.733860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] PATH_INFO: `/v3/projects/8030faed4d9945b5a6f948b931ca1d8d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:10.735395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8030faed4d9945b5a6f948b931ca1d8d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:10.737906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:10.869260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8030faed4d9945b5a6f948b931ca1d8d', 'request_id': 'req-26eaec57-898b-4a55-a3c0-8b206db0a9c2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:10.953489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8030faed4d9945b5a6f948b931ca1d8d', 'request_id': 'req-26eaec57-898b-4a55-a3c0-8b206db0a9c2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:10.960215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8030faed4d9945b5a6f948b931ca1d8d', 'request_id': 'req-26eaec57-898b-4a55-a3c0-8b206db0a9c2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:10.978480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] The token cache is being invalidate because project 8030faed4d9945b5a6f948b931ca1d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:10.979450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:10.989146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:10.992944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1187/2350] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:10 2022] DELETE /identity/v3/projects/8030faed4d9945b5a6f948b931ca1d8d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:10.997605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:11.002940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:11.009866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f98744-5363-47a0-baa8-0d18f9b5c849 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:11.074268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:11.075679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:11.076073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:11.076393 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] PATH_INFO: `/v3/users/94ff9fa15c9a4401b54168af281eee2f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:11.077807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ff9fa15c9a4401b54168af281eee2f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:11.079792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:11.139944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:11.148586 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:11.224971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eaec57-898b-4a55-a3c0-8b206db0a9c2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:11.230066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:11.230696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:11.230983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:11.231261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:11.233154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:11.241211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:11.245066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:11.246673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:11.256933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1188/2351] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:11.301337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ff9fa15c9a4401b54168af281eee2f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.302927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:11.304400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:11.318917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b37bdd-2727-4fe5-8c64-db7bda719cdd service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:11.323354 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:11.324234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:11.324560 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:11.324786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] PATH_INFO: `/v3/users/eaea1f637c35454bb2ac75c2eefc26d8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:11.326022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaea1f637c35454bb2ac75c2eefc26d8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:11.327944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:11.388799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ff9fa15c9a4401b54168af281eee2f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.389588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ff9fa15c9a4401b54168af281eee2f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.403074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ff9fa15c9a4401b54168af281eee2f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.410418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ff9fa15c9a4401b54168af281eee2f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.416422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1164/2352] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:10 2022] DELETE /identity/v3/users/94ff9fa15c9a4401b54168af281eee2f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:11.574470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaea1f637c35454bb2ac75c2eefc26d8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.639526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaea1f637c35454bb2ac75c2eefc26d8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.654877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaea1f637c35454bb2ac75c2eefc26d8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.655735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaea1f637c35454bb2ac75c2eefc26d8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.663454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaea1f637c35454bb2ac75c2eefc26d8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:11.670427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1189/2353] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:11 2022] DELETE /identity/v3/users/eaea1f637c35454bb2ac75c2eefc26d8 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:11.807296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:11.808750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:11.904927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:11.922399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:11.926593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:11.972458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a711ebc6-3886-4ff2-b1ce-7cc986d23ff9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.042328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.042936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb822a4-d819-4bb3-81a2-41879924e9ae admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.044435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.044726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.045005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] PATH_INFO: `/v3/projects/e42063b9b3fa437ab379694f2de566ba` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.046257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e42063b9b3fa437ab379694f2de566ba)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.047994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.048338 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.048859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.049177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.049454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] PATH_INFO: `/v3/projects/ba23c9c3921243999a65174ae93ce26a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.051446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba23c9c3921243999a65174ae93ce26a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.053389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.158942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e42063b9b3fa437ab379694f2de566ba', 'request_id': 'req-b035ea9b-be43-4412-919e-01c8be51d546'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.172558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:12.182425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba23c9c3921243999a65174ae93ce26a', 'request_id': 'req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.234052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e42063b9b3fa437ab379694f2de566ba', 'request_id': 'req-b035ea9b-be43-4412-919e-01c8be51d546'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.241133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e42063b9b3fa437ab379694f2de566ba', 'request_id': 'req-b035ea9b-be43-4412-919e-01c8be51d546'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.252268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] The token cache is being invalidate because project e42063b9b3fa437ab379694f2de566ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:12.252581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.253323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b035ea9b-be43-4412-919e-01c8be51d546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.255086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1165/2354] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:11 2022] DELETE /identity/v3/projects/e42063b9b3fa437ab379694f2de566ba => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:12.259767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5964e7-b9b5-4a8a-8b4c-4febc94e28e6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.260056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5964e7-b9b5-4a8a-8b4c-4febc94e28e6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.260337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5964e7-b9b5-4a8a-8b4c-4febc94e28e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.296472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba23c9c3921243999a65174ae93ce26a', 'request_id': 'req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.303765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba23c9c3921243999a65174ae93ce26a', 'request_id': 'req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.314037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] The token cache is being invalidate because project ba23c9c3921243999a65174ae93ce26a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:12.314322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.314953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ee1ad48d-dac4-40a8-87f5-4b9c4d0b152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:12.316533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1190/2355] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:11 2022] DELETE /identity/v3/projects/ba23c9c3921243999a65174ae93ce26a => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:12.319470 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-fc5964e7-b9b5-4a8a-8b4c-4febc94e28e6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:12.320795 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fc5964e7-b9b5-4a8a-8b4c-4febc94e28e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.321503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734cb3-075a-4bb7-9159-8bcdcc2e7316 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.321787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734cb3-075a-4bb7-9159-8bcdcc2e7316 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.322066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734cb3-075a-4bb7-9159-8bcdcc2e7316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.340010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-76734cb3-075a-4bb7-9159-8bcdcc2e7316 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:12.341218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-76734cb3-075a-4bb7-9159-8bcdcc2e7316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.342491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:12.382250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1166/2356] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:12.390020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.390305 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.390581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.402753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1191/2357] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:12.412300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:12.412461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.412461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.412665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.412757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.419524 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1167/2358] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:12.423642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.430118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:12.431345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.432629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4818805-0658-400f-b2c8-686cf9b176a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.437279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.437925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.438203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.438474 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.439225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:12.439440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1192/2359] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:12.439541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.441303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.443531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.452361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94983072-b98b-456c-8090-ceac6c89a0f6 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.454160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1168/2360] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:32:12.458425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.459079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.459363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.459639 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.460626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:12.460939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.461267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.462595 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.470914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ea61-0f86-4777-85a7-a4bad1cb4d17 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.475113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1193/2361] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:32:12.475660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.476299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.476579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.476856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.477570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.481197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.483568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.493847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e6fa-7652-48ea-86ab-20fbf24dc003 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.498397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.499030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.499313 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.499589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.500275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.502297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.606696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1169/2362] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/projects => generated 387 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:12.610697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.630236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1194/2363] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:12.634723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.672980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efebb21-cdaa-4533-9495-f71e4cea1f4d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.696862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b388b7a-5cff-482f-a8f8-71f796ecbc6a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.701857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.702527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.702819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.703096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.703782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.705734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.730953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.731629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.731920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.732201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.732899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.734976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.808880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1195/2364] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:12.811617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.821314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d7d88-e666-4135-90dd-266107b0a779 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.825915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.826573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.826858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.827142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.827872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.829672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.840320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1170/2365] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:12 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:12.841925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:12.843523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.845353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1196/2366] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:12.849319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.859118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321b16e-e20a-476b-b94d-3a020dca3ba4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.859224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96056a61-dbd4-49ad-838c-8e3108e5b8ef admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.863156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.863553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.864082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.864554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.864679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.865264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.865465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.865621 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.865936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.866744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.867115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.868374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.884035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1197/2367] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:12.889519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1171/2368] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:12.889643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.890149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.891856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.895901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:12.901262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a31eaa-c85c-4e2f-924e-7b69a1ee60b6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.905998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.910561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.910561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.910561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.910561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.910561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.920464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1172/2369] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:12.921106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:12.932677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe3ba1-967e-4e2c-937b-1640ac78b57d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.937846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.939345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.939345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.939345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] PATH_INFO: `/v3/projects/d86ebdd467ba43a0bbac6a95a38d9443/users/113a994360c24b90993e56171bb1204b/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.954609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86ebdd467ba43a0bbac6a95a38d9443, user_id=113a994360c24b90993e56171bb1204b, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.958391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205d51-65f1-4c06-99e1-59928c3a5d4b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.968068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb4f296-8af8-4c06-b5aa-0b0e0e8e9fce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:12.971795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:12.972504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:12.972862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:12.973720 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:12.975068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:12.987082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:12.988763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:12.998231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1198/2370] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:13.002359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.008444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ba19-8d42-4cae-8a60-b1d4585e509d service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.012981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.013878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.014159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.014434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] PATH_INFO: `/v3/projects/139527c9b3db4a58a63ca67e967fb63d/users/f5f6d31c069441e0a0c0307db28e2bf5/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.029463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] RBAC: Authorizing `identity:create_grant(project_id=139527c9b3db4a58a63ca67e967fb63d, user_id=f5f6d31c069441e0a0c0307db28e2bf5, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.032105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8accf6f-ce92-4a5f-adce-889cf235810f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.056158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1173/2371] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:12 2022] PUT /identity/v3/projects/d86ebdd467ba43a0bbac6a95a38d9443/users/113a994360c24b90993e56171bb1204b/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:13.066557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.066851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.067129 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.093894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] MFA Rules not processed for user `113a994360c24b90993e56171bb1204b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:13.095099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:13.110699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1199/2372] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:12 2022] PUT /identity/v3/projects/139527c9b3db4a58a63ca67e967fb63d/users/f5f6d31c069441e0a0c0307db28e2bf5/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:13.121533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.121988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.122411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.151625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] MFA Rules not processed for user `f5f6d31c069441e0a0c0307db28e2bf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:13.152819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:13.167692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1174/2373] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:13.173109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.227770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1200/2374] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:13.232194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.247397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201092f5-49ff-46be-a0be-fe3384a31cbb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.283479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:13.303856 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a268e-27ad-4511-ac0f-58376eff2387 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.308790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.309664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.310040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.310418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.311214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.313260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.314247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.314918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.315335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.315996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.317391 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.319323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.330014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:13.408677 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1201/2375] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:13.410483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.436077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1175/2376] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:13.440151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.478596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfc1ea-f4eb-4889-887f-d2e2820e5da0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.509993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a494-ed69-4917-890b-7397c642c892 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.515390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.516649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.516940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.517254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.517961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.520682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.539275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.539951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.540236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.540512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.541234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.546396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.600549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1176/2377] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:13.604383 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.615195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b5b55-fa9a-4608-a922-73b44ce7fa56 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.620091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.620675 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.620962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.621468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.622209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.626634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1202/2378] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:13.626796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.627924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.642434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1177/2379] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:13.642630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25dbc5-a2e9-45aa-bd2c-f304365c7529 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.643570 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.647335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.648245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.648633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.649007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.649878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.651604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.655272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4139978c-b8e1-4b43-8697-046d9028f594 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.660479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.661451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.661773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.662058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] PATH_INFO: `/v3/projects/c006ba7ca3204c20b11d6868ddd96810/users/e5f695779a7e4b398cde0f26837a3131/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.667055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1203/2380] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:13.668177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.678425 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a71462-bbc0-4276-94b5-ea6492457806 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.682469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c006ba7ca3204c20b11d6868ddd96810, user_id=e5f695779a7e4b398cde0f26837a3131, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.683269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.684211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.684563 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.685191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.685320 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] PATH_INFO: `/v3/projects/e4c26c9b18224704a719ab1cd146e46d/users/4bf15daf6a6443c2a0c7bf6cb7e265d6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.701700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c26c9b18224704a719ab1cd146e46d, user_id=4bf15daf6a6443c2a0c7bf6cb7e265d6, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.704376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.747937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1178/2381] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:13 2022] PUT /identity/v3/projects/c006ba7ca3204c20b11d6868ddd96810/users/e5f695779a7e4b398cde0f26837a3131/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:13.751714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.771282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1204/2382] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:13 2022] PUT /identity/v3/projects/e4c26c9b18224704a719ab1cd146e46d/users/4bf15daf6a6443c2a0c7bf6cb7e265d6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:13.776077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.810095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:13.825517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531a5f2-db4f-447f-9f28-8bd21c43f7d5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.843451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af79d16-2f7c-4c1d-b178-182060a73a3f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.850086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.850897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.851183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.856136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.856136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.856136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.865054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1205/2383] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:13.869110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.880336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:13.880484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829f1f0-afa8-4c2c-8159-3cf34a03e2bf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.887211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.890836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.890836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.890836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] PATH_INFO: `/v3/projects/e4c26c9b18224704a719ab1cd146e46d/users/4bf15daf6a6443c2a0c7bf6cb7e265d6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.890836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4c26c9b18224704a719ab1cd146e46d, user_id=4bf15daf6a6443c2a0c7bf6cb7e265d6, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.891499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.892550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.892550 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.893216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.893378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.894970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:13.896312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3851f37-806d-488b-81da-86386735da4f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:13.906386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1206/2384] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:13 2022] PUT /identity/v3/projects/e4c26c9b18224704a719ab1cd146e46d/users/4bf15daf6a6443c2a0c7bf6cb7e265d6/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:13.906833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1179/2385] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:13 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:13.914466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:13.918994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.924401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.924401 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:13.948590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] MFA Rules not processed for user `4bf15daf6a6443c2a0c7bf6cb7e265d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:13.950098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:13.991726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0401f4-d030-4204-bff9-667e33852082 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:13.997713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:13.999546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:13.999546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:13.999546 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] PATH_INFO: `/v3/projects/c006ba7ca3204c20b11d6868ddd96810/users/e5f695779a7e4b398cde0f26837a3131/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:14.001204 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c006ba7ca3204c20b11d6868ddd96810, user_id=e5f695779a7e4b398cde0f26837a3131, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:14.004525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37402c-ea2a-4076-af71-629e8cf1ce13 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:14.015023 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1207/2386] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:13 2022] PUT /identity/v3/projects/c006ba7ca3204c20b11d6868ddd96810/users/e5f695779a7e4b398cde0f26837a3131/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:14.024268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1180/2387] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:14.027033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:14.027389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:14.027673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:14.035261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:14.037642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:14.066357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] MFA Rules not processed for user `e5f695779a7e4b398cde0f26837a3131`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:14.067844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:14.145883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928512a0-21c2-480c-8cee-07952101dfbc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:14.186125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1208/2388] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:14.200766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:14.202473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:14.206590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:14.207498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:14.207966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:14.208469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:14.217780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86d9fe-86e3-44b8-a537-6c524205c252 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:14.224035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:14.224791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:14.225591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:14.225944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:14.234478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:14.240070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:14.242120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:14.255208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1209/2389] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:14.283941 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:14.286059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:14.296616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1181/2390] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:14.414524 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:14.423590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b01cfa-b3f6-4d73-b91f-7d7923f6ad44 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:14.428306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:14.429132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:14.429255 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:14.429521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:14.443399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:14.488605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:14.490077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3090fb6b-4c5d-4533-9bb5-b5f20ebb1b4e service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:14.499290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1210/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:15.431406 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:15.501123 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bfc33-a430-406e-be39-9261067a3e6b service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:15.506949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:15.507826 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:15.508112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:15.508403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] PATH_INFO: `/v3/users/f5f6d31c069441e0a0c0307db28e2bf5` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:15.509648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f6d31c069441e0a0c0307db28e2bf5)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:15.511601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:15.670983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f6d31c069441e0a0c0307db28e2bf5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:15.759932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f6d31c069441e0a0c0307db28e2bf5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:15.760571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f6d31c069441e0a0c0307db28e2bf5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:15.774085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f6d31c069441e0a0c0307db28e2bf5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:15.783857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f6d31c069441e0a0c0307db28e2bf5'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:15.787930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1182/2392] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:15 2022] DELETE /identity/v3/users/f5f6d31c069441e0a0c0307db28e2bf5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:15.792408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:15.792878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:15.792972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:15.811195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:15.812373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:15.884593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1211/2393] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:15.894034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:15.895931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:15.947145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:16.019316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efccb9-cd19-4e54-b047-375d3460d127 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:16.024362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:16.025370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:16.025687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:16.025968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:16.038337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:16.040119 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:16.057300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1183/2394] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:16.664493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:16.666347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:16.681922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476d93-3948-400e-b9dc-45da7f490279 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:16.686774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:16.688323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:16.688957 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:16.689306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] PATH_INFO: `/v3/projects/139527c9b3db4a58a63ca67e967fb63d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:16.690602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=139527c9b3db4a58a63ca67e967fb63d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:16.692500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:16.807293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139527c9b3db4a58a63ca67e967fb63d', 'request_id': 'req-9afde514-fffb-4a57-a955-ea8174cb3dbf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:16.891889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139527c9b3db4a58a63ca67e967fb63d', 'request_id': 'req-9afde514-fffb-4a57-a955-ea8174cb3dbf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:16.908198 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139527c9b3db4a58a63ca67e967fb63d', 'request_id': 'req-9afde514-fffb-4a57-a955-ea8174cb3dbf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:16.922753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] The token cache is being invalidate because project 139527c9b3db4a58a63ca67e967fb63d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:16.923265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:16.923826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:16.934093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1212/2395] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:16 2022] DELETE /identity/v3/projects/139527c9b3db4a58a63ca67e967fb63d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:16.934689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:16.943001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc88439-50c3-409c-9859-2a0277619506 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:17.035183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:17.036222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:17.036599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:17.036975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] PATH_INFO: `/v3/users/4bf15daf6a6443c2a0c7bf6cb7e265d6` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:17.038334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf15daf6a6443c2a0c7bf6cb7e265d6)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:17.040323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:17.082391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:17.084059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:17.101447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afde514-fffb-4a57-a955-ea8174cb3dbf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:17.106983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:17.108053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:17.108394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:17.108680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] PATH_INFO: `/v3/users/71b891b8ddd648a29944dd04172a01d7` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:17.109948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71b891b8ddd648a29944dd04172a01d7)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:17.111921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:17.281364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf15daf6a6443c2a0c7bf6cb7e265d6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.301231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:17.310263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71b891b8ddd648a29944dd04172a01d7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.352840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf15daf6a6443c2a0c7bf6cb7e265d6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.353508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf15daf6a6443c2a0c7bf6cb7e265d6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.366838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf15daf6a6443c2a0c7bf6cb7e265d6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.373737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf15daf6a6443c2a0c7bf6cb7e265d6'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.379768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1184/2396] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:16 2022] DELETE /identity/v3/users/4bf15daf6a6443c2a0c7bf6cb7e265d6 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:17.439787 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71b891b8ddd648a29944dd04172a01d7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.452934 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71b891b8ddd648a29944dd04172a01d7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.453690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71b891b8ddd648a29944dd04172a01d7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.461080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71b891b8ddd648a29944dd04172a01d7'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:17.467322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1213/2397] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:17 2022] DELETE /identity/v3/users/71b891b8ddd648a29944dd04172a01d7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:17.809529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:17.809529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:17.839189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:17.840770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:17.852327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:17.874649 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e152-3b84-4a7b-b0a7-cf1d4cfe5c1b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:17.916671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ebf6c-67e2-457d-8587-3b425a7f7cd2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:17.922076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:17.923079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:17.923387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:17.923861 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] PATH_INFO: `/v3/projects/e4c26c9b18224704a719ab1cd146e46d` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:17.925254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4c26c9b18224704a719ab1cd146e46d)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:17.927254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:17.936537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:17.937499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:17.937798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:17.938076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] PATH_INFO: `/v3/projects/6e21268b20834313a5a48010dd832059` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:17.939281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e21268b20834313a5a48010dd832059)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:17.941349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.024719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4c26c9b18224704a719ab1cd146e46d', 'request_id': 'req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.064008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e21268b20834313a5a48010dd832059', 'request_id': 'req-c202bed8-3342-4356-88a5-722868837127'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.101264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4c26c9b18224704a719ab1cd146e46d', 'request_id': 'req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.108258 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4c26c9b18224704a719ab1cd146e46d', 'request_id': 'req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.119458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] The token cache is being invalidate because project e4c26c9b18224704a719ab1cd146e46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:18.119746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.120367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-cf1cb922-93b7-4df4-b182-a7273f0d2ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.121981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1214/2398] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:17 2022] DELETE /identity/v3/projects/e4c26c9b18224704a719ab1cd146e46d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:18.126520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce03d4-03d1-422c-8aa1-cc3cc70f8881 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.126812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce03d4-03d1-422c-8aa1-cc3cc70f8881 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.127090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce03d4-03d1-422c-8aa1-cc3cc70f8881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.144776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dbce03d4-03d1-422c-8aa1-cc3cc70f8881 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.146011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dbce03d4-03d1-422c-8aa1-cc3cc70f8881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.169915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e21268b20834313a5a48010dd832059', 'request_id': 'req-c202bed8-3342-4356-88a5-722868837127'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.176468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e21268b20834313a5a48010dd832059', 'request_id': 'req-c202bed8-3342-4356-88a5-722868837127'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.186770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:18.189469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] The token cache is being invalidate because project 6e21268b20834313a5a48010dd832059 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:18.189809 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.190815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-c202bed8-3342-4356-88a5-722868837127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:18.192707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1185/2399] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:17 2022] DELETE /identity/v3/projects/6e21268b20834313a5a48010dd832059 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:18.197345 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac3fd-4836-46c5-8d1e-d81722038b3d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.197630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac3fd-4836-46c5-8d1e-d81722038b3d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.197910 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ac3fd-4836-46c5-8d1e-d81722038b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.209151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1215/2400] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.221585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.222444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.222759 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.231823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5f1ac3fd-4836-46c5-8d1e-d81722038b3d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.233040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f1ac3fd-4836-46c5-8d1e-d81722038b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.242020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1186/2401] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.243187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.243749 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.249537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.249746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.250021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.251954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1216/2402] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.255972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.265386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe78d67-4eb4-4c89-9069-95be8ebeccb9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.270463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.271123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.271245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.271402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.271674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.272378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.272523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:18.272734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.274386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.280299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1187/2403] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.286699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.288199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1217/2404] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:32:18.292149 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.296471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b658-c76f-4fa9-9cbc-ea2183b6e07b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.301948 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.306300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e18f1c9-de2c-48de-b350-899d7c9fa326 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.306429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.308704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.309381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.309665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.309941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.310631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.312604 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.317782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1188/2405] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:32:18.322206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.337131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6f2d1-3e51-408c-a55c-2e4602b56c6e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.337440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.338086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.338369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.338646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.339588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.341560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.446509 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1189/2406] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:18.451883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1218/2407] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:18.452019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.452126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.512704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2b4c-33c7-43c3-a7dc-af55e7676cfc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.514772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904660b-2ed2-49bb-a1ca-523a2fb65143 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.517507 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.518209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.518496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.519308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.520013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.520371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.521067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.521360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.521633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.521945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.522315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.524227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.615956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1190/2408] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:18.620013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.629356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6062931-612b-4dec-bffe-d46f38415b10 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.634170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.638726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.638726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.638726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.638726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.638726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.648033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1191/2409] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:18.651645 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.659929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:18.663652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53445b5-50a2-4e95-a28d-62dd6ca34e09 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.667487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1219/2410] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:18.668691 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.669448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.669731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.670149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.670888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.672572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.674878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.687624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1192/2411] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:18.687788 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162aa1a-666c-4fcf-b940-5cf508a29953 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.689063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.691058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.692135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.692506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.692874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.693795 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.696520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.703091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe8ce4-3219-4829-9d92-31618510efc4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.706909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1220/2412] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:18.709008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.709934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.710218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.710498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] PATH_INFO: `/v3/projects/bef2d45b84a34188bdd2e6048713b28e/users/6c63ec44c1664319a0dd1b31cdfc1df0/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.710901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.721611 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416681c-84a1-44a7-bea5-bc0c9abd3158 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.726938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.727592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.727874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.727988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef2d45b84a34188bdd2e6048713b28e, user_id=6c63ec44c1664319a0dd1b31cdfc1df0, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.728150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.728873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.730551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.736436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ae4c1-eebf-4dad-a327-865d7e5f74d8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.741847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1221/2413] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:18.745955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.756068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3c0a3-724a-42bd-98ba-12c419e61b91 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:18.760690 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:18.761566 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.761850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.762140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] PATH_INFO: `/v3/projects/794bac898c644a2795a5fafb71e1e33b/users/87c1b9d52fec4eef873efa1fdff2eae3/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.776442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794bac898c644a2795a5fafb71e1e33b, user_id=87c1b9d52fec4eef873efa1fdff2eae3, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:18.779175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f33365-83a3-466e-8a2b-e7e83251e4d9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:18.794968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1193/2414] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:18 2022] PUT /identity/v3/projects/bef2d45b84a34188bdd2e6048713b28e/users/6c63ec44c1664319a0dd1b31cdfc1df0/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:18.806519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.806810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.807088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.833441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] MFA Rules not processed for user `6c63ec44c1664319a0dd1b31cdfc1df0`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.834630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.856433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1222/2415] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:18 2022] PUT /identity/v3/projects/794bac898c644a2795a5fafb71e1e33b/users/87c1b9d52fec4eef873efa1fdff2eae3/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:18.866906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:18.867079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:18.867352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:18.893362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] MFA Rules not processed for user `87c1b9d52fec4eef873efa1fdff2eae3`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:18.895413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.899424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1194/2416] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.911997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.913408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.929703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:18.963652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1223/2417] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:18.977333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:18.978826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:18.991646 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08849eb6-0369-431e-ae02-adda82e56f89 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:19.037433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd74601-1d36-4d01-8dc0-5af3e2cf97d8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:19.041363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:19.042018 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:19.042305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:19.042579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:19.051767 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:19.053444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:19.055843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:19.056492 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:19.056772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:19.057070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:19.062492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1224/2418] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:19.082669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:19.117071 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:19.118531 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2097bf73-b2a6-420a-907c-2e88045397ef service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:19.127706 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1195/2419] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:19.131977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:19.147179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965313a-9de9-460c-bdff-907ef84c7c88 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:19.151835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:19.152706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:19.152984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:19.153291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] PATH_INFO: `/v3/users/87c1b9d52fec4eef873efa1fdff2eae3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:19.154491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c1b9d52fec4eef873efa1fdff2eae3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:19.156403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:19.327212 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c1b9d52fec4eef873efa1fdff2eae3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:19.394250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c1b9d52fec4eef873efa1fdff2eae3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:19.406542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c1b9d52fec4eef873efa1fdff2eae3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:19.407197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c1b9d52fec4eef873efa1fdff2eae3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:19.412580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:19.414679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c1b9d52fec4eef873efa1fdff2eae3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:19.420646 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1225/2420] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:19 2022] DELETE /identity/v3/users/87c1b9d52fec4eef873efa1fdff2eae3 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:19.426713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b577-8565-416e-9388-8fb352785949 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:19.426713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b577-8565-416e-9388-8fb352785949 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:19.426713 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b577-8565-416e-9388-8fb352785949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:19.444613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-6769b577-8565-416e-9388-8fb352785949 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:19.445843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6769b577-8565-416e-9388-8fb352785949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:19.502723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1196/2421] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:19.513312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:19.514761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:19.572669 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc302e-3427-43de-8d8c-6d9742d126e9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:19.576441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:19.581649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:19.581649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:19.581649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:19.586949 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:19.588382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d533133-7dcb-4547-99c8-23260c763313 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:19.598862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1226/2422] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:20.021894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769b577-8565-416e-9388-8fb352785949 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.021894 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6769b577-8565-416e-9388-8fb352785949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:20.032705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6769b577-8565-416e-9388-8fb352785949 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.038917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.039833 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.040467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.040638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] PATH_INFO: `/v3/projects/794bac898c644a2795a5fafb71e1e33b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.041794 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=794bac898c644a2795a5fafb71e1e33b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.044045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.159335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:20.171231 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794bac898c644a2795a5fafb71e1e33b', 'request_id': 'req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:20.244187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794bac898c644a2795a5fafb71e1e33b', 'request_id': 'req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:20.250774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794bac898c644a2795a5fafb71e1e33b', 'request_id': 'req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:20.263135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] The token cache is being invalidate because project 794bac898c644a2795a5fafb71e1e33b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:20.263427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:20.264108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ad1fea6b-6cc9-4f9b-b776-435e7c7cba71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:20.265677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1197/2423] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:20 2022] DELETE /identity/v3/projects/794bac898c644a2795a5fafb71e1e33b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:20.270589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.271077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.271168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.290069 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:20.291347 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:20.352846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1227/2424] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:20.361567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.361862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.362141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.381172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:20.382377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:20.391254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1198/2425] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:20.396418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.406308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fa308-8697-46af-88a6-76af0b9409b7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.411194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.411879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.416804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.416804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.416804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:20.416804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.416804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.427172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1228/2426] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:20.431471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.442161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ffb51-d90f-4028-a161-66c3cfcebdac None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.446818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.447467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.447745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.448017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.448711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.450749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.522867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1199/2427] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:20 2022] POST /identity/v3/projects => generated 367 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:20.526766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.537076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d2d95-9f1a-4269-8b14-07a74aa9c118 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.594231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.594903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.595183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.595458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.596145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.598086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.698008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1229/2428] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:20 2022] POST /identity/v3/users => generated 284 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:20.701982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.713124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a67bef-8c58-42ce-bafd-07cd2c409fc0 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.718088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.718756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.719041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.719321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.720063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.721932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.733321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1200/2429] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:20.737766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.747776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd4df9-da22-4cba-a99c-d91a59a4e1d5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.752908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.754211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.754498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.754785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.755523 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.757144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de2d2c-1d29-446f-a9d8-ec183369bfb9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.767550 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1230/2430] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:20.771692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:20.781913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebc458-1f2f-4d43-b34b-90385a031dd2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:20.786839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:20.787851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.788141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.788423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] PATH_INFO: `/v3/projects/48cdc8aa097c48e5985029243529ca93/users/8f822962d77f449b89c00c6c6952ea16/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.804628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48cdc8aa097c48e5985029243529ca93, user_id=8f822962d77f449b89c00c6c6952ea16, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:20.807420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:20.884582 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1201/2431] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:20 2022] PUT /identity/v3/projects/48cdc8aa097c48e5985029243529ca93/users/8f822962d77f449b89c00c6c6952ea16/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:20.895487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:20.895801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:20.896082 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:20.903672 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:20.924725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] MFA Rules not processed for user `8f822962d77f449b89c00c6c6952ea16`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:20.926092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:20.996343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1231/2432] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:21.010030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:21.011771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:21.071399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8933f0-c693-4e83-967a-51a4860cab22 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:21.075013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:21.078697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:21.078697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:21.078697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:21.084837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:21.086398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb1cc4-6cff-4137-985a-1f71f0868c60 service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:21.095799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1202/2433] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:22.321991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:22.321991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:22.406325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106e2a5-b462-4fe0-beed-3f5216df0094 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:22.411326 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:22.412240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:22.412526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:22.412803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] PATH_INFO: `/v3/users/6c63ec44c1664319a0dd1b31cdfc1df0` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:22.414093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c63ec44c1664319a0dd1b31cdfc1df0)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:22.416334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:22.572495 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c63ec44c1664319a0dd1b31cdfc1df0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:22.632480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c63ec44c1664319a0dd1b31cdfc1df0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:22.646793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c63ec44c1664319a0dd1b31cdfc1df0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:22.647486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c63ec44c1664319a0dd1b31cdfc1df0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:22.654665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c63ec44c1664319a0dd1b31cdfc1df0'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:22.661357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1232/2434] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:22 2022] DELETE /identity/v3/users/6c63ec44c1664319a0dd1b31cdfc1df0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:22.666257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:22.666739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:22.670098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:22.687965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:22.689238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:22.749557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:22.757911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1203/2435] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:22.767886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:22.769380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:22.783644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:22.828629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401540d3-636b-43e0-bbc2-fa285a880b81 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:22.832724 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:22.833390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:22.833668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:22.833939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:22.843279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:22.845457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d12f9d-6273-46ca-a61d-c864539e5b8c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:22.856686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1233/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:23.314991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:23.316542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:23.329246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83957de3-a3ff-4dae-801c-573877a9d169 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:23.335510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:23.336323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.336601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.336872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] PATH_INFO: `/v3/projects/bef2d45b84a34188bdd2e6048713b28e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.338146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef2d45b84a34188bdd2e6048713b28e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:23.340408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:23.452867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef2d45b84a34188bdd2e6048713b28e', 'request_id': 'req-30a32a83-0f76-44a8-993e-2c5db32e8fa2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:23.530680 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef2d45b84a34188bdd2e6048713b28e', 'request_id': 'req-30a32a83-0f76-44a8-993e-2c5db32e8fa2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:23.538792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef2d45b84a34188bdd2e6048713b28e', 'request_id': 'req-30a32a83-0f76-44a8-993e-2c5db32e8fa2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:23.556461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] The token cache is being invalidate because project bef2d45b84a34188bdd2e6048713b28e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:23.556749 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:23.557609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-30a32a83-0f76-44a8-993e-2c5db32e8fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:23.559194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1204/2437] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:23 2022] DELETE /identity/v3/projects/bef2d45b84a34188bdd2e6048713b28e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:23.564537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.565072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.565215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.583804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:23.585016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:23.648357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1234/2438] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:23.656389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.656711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.657149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.676785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:23.678030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:23.686209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1205/2439] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:23.690972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:23.700919 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ea788-df18-4ae6-8dbd-edabdaa7e486 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:23.705875 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:23.706543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.706831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.707662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.708403 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:23.708717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:23.710371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:23.729775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1235/2440] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:23.734227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:23.743579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f9f22-a632-4016-ab23-fab74ae2001c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:23.748206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:23.748882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.749200 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.749475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.750161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:23.752028 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:23.880942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1206/2441] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:23 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:23.885328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:23.896649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203000ef-2090-4a3b-a851-7d1925c77cb6 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:23.952904 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:23.953622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:23.953903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:23.954175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:23.954878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:23.956792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:24.050936 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1236/2442] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:23 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:24.058899 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:24.070130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84aee7c-a4d2-4564-b062-321cfadeef92 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:24.074863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:24.075553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:24.075815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:24.076112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:24.076839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:24.078473 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:24.090576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1207/2443] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:24.094828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:24.104785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b67d2c4-d3f4-4b95-ba73-e2ec1566cd19 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:24.109346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:24.109995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:24.110277 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:24.110556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:24.111276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:24.112874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c3688-70ff-46ea-b123-3e8edaec105d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:24.123439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1237/2444] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:24.127459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:24.138773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547be38a-fea1-4a45-a8c9-b78194989e54 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:24.143666 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:24.144568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:24.144852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:24.145165 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] PATH_INFO: `/v3/projects/2b1aab4cfe07484a9e8258795555c28a/users/d556ff0918e44e568e973f03862c9f22/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:24.160962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1aab4cfe07484a9e8258795555c28a, user_id=d556ff0918e44e568e973f03862c9f22, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:24.163668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:24.205295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1208/2445] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:24 2022] PUT /identity/v3/projects/2b1aab4cfe07484a9e8258795555c28a/users/d556ff0918e44e568e973f03862c9f22/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:24.216850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:24.217229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:24.217511 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:24.244051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] MFA Rules not processed for user `d556ff0918e44e568e973f03862c9f22`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:24.245293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:24.254718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:24.312613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1238/2446] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:24 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:24.324187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:24.326093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:24.386499 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3890a-2eb0-46c4-bbcb-bd899f55ef34 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:24.390297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:24.390888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:24.391169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:24.391441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:24.400567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:24.402167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b1cc6-b2db-46e9-af97-4bef8cffd2d8 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:24.410977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1209/2447] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:34.183504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:34.250942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64770ac6-9a91-4c47-827d-049a2e2c4f04 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:34.255480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:34.256351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:34.256631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:34.256905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] PATH_INFO: `/v3/users/d556ff0918e44e568e973f03862c9f22` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:34.258121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d556ff0918e44e568e973f03862c9f22)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:34.260159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:34.406837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:34.435870 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd556ff0918e44e568e973f03862c9f22'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:34.507066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd556ff0918e44e568e973f03862c9f22'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:34.520959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd556ff0918e44e568e973f03862c9f22'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:34.521683 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd556ff0918e44e568e973f03862c9f22'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:34.531559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd556ff0918e44e568e973f03862c9f22'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:34.540939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1239/2448] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:34 2022] DELETE /identity/v3/users/d556ff0918e44e568e973f03862c9f22 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:34.542837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:34.545078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:34.545078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:34.563693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:34.566511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:34.633918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1210/2449] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:34.644808 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:34.646263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:34.807358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:34.833577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56987d0d-c931-40da-912c-091d4e0b509d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:34.837253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:34.837772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:34.838721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:34.838721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:34.849040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:34.850561 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fb6d1-c1f1-4ec1-acf6-41dc548dc7af service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:34.861207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1240/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:35.708594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:35.711020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:35.733172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe43948-8171-4996-87f4-ab442373b7bc None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:35.745931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:35.748523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:35.748523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:35.749074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] PATH_INFO: `/v3/projects/2b1aab4cfe07484a9e8258795555c28a` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:35.750692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1aab4cfe07484a9e8258795555c28a)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:35.752784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:35.847792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1aab4cfe07484a9e8258795555c28a', 'request_id': 'req-b8525f8a-fe99-4278-a0d5-976fd89d5848'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:35.896193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1aab4cfe07484a9e8258795555c28a', 'request_id': 'req-b8525f8a-fe99-4278-a0d5-976fd89d5848'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:35.905641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1aab4cfe07484a9e8258795555c28a', 'request_id': 'req-b8525f8a-fe99-4278-a0d5-976fd89d5848'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:35.919049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] The token cache is being invalidate because project 2b1aab4cfe07484a9e8258795555c28a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:35.919347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:35.920077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b8525f8a-fe99-4278-a0d5-976fd89d5848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:35.921731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1211/2451] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:35 2022] DELETE /identity/v3/projects/2b1aab4cfe07484a9e8258795555c28a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:35.926860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:35.927287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:35.927287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:35.945862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:35.947072 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:36.011196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1241/2452] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:36.021486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.021784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.022069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.046517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:36.047922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:36.061884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1212/2453] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:36.062715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.073118 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45984350-3468-44f4-a91f-19c9b764ea5e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.083133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.084167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.084670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.085377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.087208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:36.087208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.088786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.104360 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1242/2454] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:36.109289 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.119229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670cfcf-db86-41c2-995a-f354b6011e0e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.124579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.125297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.125586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.125870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.126605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.128554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.248467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1213/2455] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:36 2022] POST /identity/v3/projects => generated 403 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:36.252441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.265797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d25d5-3a1f-4c73-a116-c2c4900f0331 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.381829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.382430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.382708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.382977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.383750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.385691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.501457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1243/2456] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:36 2022] POST /identity/v3/users => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:36.505375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.517788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671e97-0ea4-46c5-8dcc-4edc5d555b9c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.527738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.528639 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.528868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.529202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.529939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.531535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.543467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1214/2457] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:36.547569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.557288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba483-6c47-42ae-81a2-d1d59fb585c8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.562369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.563014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.563292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.563564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.564285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.565892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b5055-df8f-41d3-af92-460f65ab0d85 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.575597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1244/2458] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:36.579568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.589887 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae02e-c723-4bad-a8c4-3cc4f7e0bcae admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.594559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.595431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.595708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.595977 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] PATH_INFO: `/v3/projects/92a6f9ca8b2a4b03bb7601a3241ea74a/users/fdbb9c5be7374afe96941ff0bc93b28f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.612051 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a6f9ca8b2a4b03bb7601a3241ea74a, user_id=fdbb9c5be7374afe96941ff0bc93b28f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.614714 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:36.719654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1215/2459] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:36 2022] PUT /identity/v3/projects/92a6f9ca8b2a4b03bb7601a3241ea74a/users/fdbb9c5be7374afe96941ff0bc93b28f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:36.730850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.731220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.731565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.761906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] MFA Rules not processed for user `fdbb9c5be7374afe96941ff0bc93b28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:36.763216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:36.794953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:36.834665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1245/2460] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:36.839436 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:36.861423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:36.902269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fbd971-4908-47a4-a31f-9c7581931506 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:36.906579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:36.907236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:36.907523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:36.907807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:36.908511 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:36.910423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.010970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1216/2461] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:36 2022] POST /identity/v3/projects => generated 405 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:37.015380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.026077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a22c42-7a70-40a3-a457-d77e2a0abe20 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.080526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.081205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.081485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.081752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.082415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.084310 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.187551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1246/2462] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:37 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:37.191697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.203457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa40f400-9f9e-413e-87cd-04174fdbaa67 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.211151 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.219259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.219259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.219259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.219259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.219259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.226845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1217/2463] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:37.232007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.241993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02cb9d-3866-44c2-b83f-1a6ff5251f43 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.246713 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.248390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.248390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.248390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] PATH_INFO: `/v3/projects/747a4ab0153c48d4a08f61477e5f4e39/users/5de7d5ce2de9459ebd01539068d58ffc/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.262881 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a4ab0153c48d4a08f61477e5f4e39, user_id=5de7d5ce2de9459ebd01539068d58ffc, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.265568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.354509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1247/2464] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:37 2022] PUT /identity/v3/projects/747a4ab0153c48d4a08f61477e5f4e39/users/5de7d5ce2de9459ebd01539068d58ffc/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:37.358557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.368625 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522b124-080d-4b91-8573-4b73feccb26d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.433457 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.434088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.434405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.434686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.435415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.437010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb3459-c416-40b3-8dcd-cc72c14bce7d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.447139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1218/2465] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:37.452010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.462375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd84417d-aa2e-4224-8a1d-1e2c3462032f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.467888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.468758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.469066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.469351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] PATH_INFO: `/v3/projects/747a4ab0153c48d4a08f61477e5f4e39/users/5de7d5ce2de9459ebd01539068d58ffc/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.471307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=747a4ab0153c48d4a08f61477e5f4e39, user_id=5de7d5ce2de9459ebd01539068d58ffc, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.473970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.484246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1248/2466] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:37 2022] PUT /identity/v3/projects/747a4ab0153c48d4a08f61477e5f4e39/users/5de7d5ce2de9459ebd01539068d58ffc/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:37.495819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.496110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.496532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.523765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] MFA Rules not processed for user `5de7d5ce2de9459ebd01539068d58ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:37.524983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:37.610362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1219/2467] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:37.620790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.623077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:37.690671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3fcb3-d6cc-4c68-8816-d622cb65f71b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.694883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.695609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.696701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.696701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.708035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.709526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7940a47-5d63-4ced-a320-cf7160b4f016 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:37.720339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1249/2468] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:37 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:37.896510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:37.916636 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:37.973155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9694bab9-90f2-41ac-aeb5-346b5022b513 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:37.977771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:37.978676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:37.978960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:37.979241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] PATH_INFO: `/v3/users/fdbb9c5be7374afe96941ff0bc93b28f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:37.980658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdbb9c5be7374afe96941ff0bc93b28f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:37.982724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:38.189938 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdbb9c5be7374afe96941ff0bc93b28f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:38.296488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdbb9c5be7374afe96941ff0bc93b28f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:38.297621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdbb9c5be7374afe96941ff0bc93b28f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:38.311720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdbb9c5be7374afe96941ff0bc93b28f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:38.319074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdbb9c5be7374afe96941ff0bc93b28f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:38.325597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1220/2469] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:37 2022] DELETE /identity/v3/users/fdbb9c5be7374afe96941ff0bc93b28f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:38.330178 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:38.330708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:38.330818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:38.349496 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:38.350737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:38.370307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:38.415525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1250/2470] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:38.426361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:38.434559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:38.489386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62296a1-f509-4391-b5a1-d59d3acccefc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:38.493105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:38.493751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:38.494038 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:38.494347 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:38.503974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:38.505461 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:38.515055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1221/2471] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:38.904145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:38.905599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:38.918782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d133064-18c0-43eb-b1d5-366a4f1e32cd None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:38.923581 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:38.924628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:38.924937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:38.925246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] PATH_INFO: `/v3/projects/92a6f9ca8b2a4b03bb7601a3241ea74a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:38.926483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a6f9ca8b2a4b03bb7601a3241ea74a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:38.928612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:39.028579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a6f9ca8b2a4b03bb7601a3241ea74a', 'request_id': 'req-27392630-83fa-48ab-ad33-1a4247e37c5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.124437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a6f9ca8b2a4b03bb7601a3241ea74a', 'request_id': 'req-27392630-83fa-48ab-ad33-1a4247e37c5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.131370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a6f9ca8b2a4b03bb7601a3241ea74a', 'request_id': 'req-27392630-83fa-48ab-ad33-1a4247e37c5a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.142293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] The token cache is being invalidate because project 92a6f9ca8b2a4b03bb7601a3241ea74a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:39.142580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.146140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.146140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1251/2472] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:38 2022] DELETE /identity/v3/projects/92a6f9ca8b2a4b03bb7601a3241ea74a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:39.148851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:39.159146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36829255-4bda-4d4f-889a-8d0266a20604 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:39.195207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:39.218725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:39.219623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:39.219917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:39.220230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] PATH_INFO: `/v3/users/5de7d5ce2de9459ebd01539068d58ffc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:39.221454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de7d5ce2de9459ebd01539068d58ffc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:39.223386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:39.401325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de7d5ce2de9459ebd01539068d58ffc'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.530532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de7d5ce2de9459ebd01539068d58ffc'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.531149 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de7d5ce2de9459ebd01539068d58ffc'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.544607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de7d5ce2de9459ebd01539068d58ffc'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.558765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-07b15ab2-b6bd-470c-b327-7beb0a234641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de7d5ce2de9459ebd01539068d58ffc'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:39.565788 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1222/2473] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:39 2022] DELETE /identity/v3/users/5de7d5ce2de9459ebd01539068d58ffc => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:39.967436 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:39.969213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:39.982967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27392630-83fa-48ab-ad33-1a4247e37c5a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.048718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.049608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.049895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.050174 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] PATH_INFO: `/v3/projects/747a4ab0153c48d4a08f61477e5f4e39` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.051352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747a4ab0153c48d4a08f61477e5f4e39)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.053282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.142805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747a4ab0153c48d4a08f61477e5f4e39', 'request_id': 'req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:40.144429 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:40.221630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747a4ab0153c48d4a08f61477e5f4e39', 'request_id': 'req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:40.228499 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747a4ab0153c48d4a08f61477e5f4e39', 'request_id': 'req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:40.239620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] The token cache is being invalidate because project 747a4ab0153c48d4a08f61477e5f4e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:40.240011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:40.240775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d9c2b3bb-86b9-4105-98bf-d6e0a01cf7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:40.242318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1252/2474] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:39 2022] DELETE /identity/v3/projects/747a4ab0153c48d4a08f61477e5f4e39 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:40.247443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.248021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.248021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.267819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:40.269042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:40.330982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1223/2475] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:40.339323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.339613 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.339892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.358491 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:40.359688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:40.367714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1253/2476] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:40.372839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.382694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d939623-40b4-4e1f-a4b1-9d17e379b515 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.387252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.388096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.388377 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.388655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.389422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:40.389731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.391331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.402745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1224/2477] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:40.407352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.416419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf77dd-33e3-42cf-8671-7be965d700ae None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.421871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.422518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.425955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.425955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.425955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.425955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.538428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1254/2478] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:40 2022] POST /identity/v3/projects => generated 369 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:40.544479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.558075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61f3dd-60a4-4fdd-ab29-6e8ee7825637 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.620057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:40.636782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.638447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.638699 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.638974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.639743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.641740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.755801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1225/2479] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:40 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:40.759718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.770620 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74f7c2-5b72-4b2f-91d1-e6eeb19dff86 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.775130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.775782 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.782175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.782175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.782175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.782175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.791784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1255/2480] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:40.793015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.802852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45329b-216a-4a5c-8b47-0f88cca5bdcd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.807631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.808295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.808579 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.808852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.810193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.811768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05921c-9716-489e-8b4f-2d717d2e6ae8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.822979 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1226/2481] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:40.827605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:40.837815 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca4670-821f-46bb-b653-26f0b651e7ce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:40.847079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:40.847708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.847989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.848267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] PATH_INFO: `/v3/projects/4c4321a125c441fbaa69c04d7f63c4ac/users/2c2935332eda4f809e47c9724e99c682/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.867633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4321a125c441fbaa69c04d7f63c4ac, user_id=2c2935332eda4f809e47c9724e99c682, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:40.870286 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:40.942843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1256/2482] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:40 2022] PUT /identity/v3/projects/4c4321a125c441fbaa69c04d7f63c4ac/users/2c2935332eda4f809e47c9724e99c682/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:40.954362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:40.955175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:40.955175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:40.988602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] MFA Rules not processed for user `2c2935332eda4f809e47c9724e99c682`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:40.990218 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:41.050469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.052282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:41.070976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1227/2483] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:41.075226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.123525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193aae0a-fae7-457f-bdb0-0f6dcbcadcba admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.127469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.128119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.128400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.128674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.130597 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:41.147262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da614d8a-ea9f-461a-b257-1549ea435af5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.151928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.152652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.153001 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.153967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.154758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.156763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.195735 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.197217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.207406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1257/2484] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:41.270503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1228/2485] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:41 2022] POST /identity/v3/projects => generated 369 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:41.274295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.285404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a68ce-2b1b-4668-aa75-b60da8d8bacc service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.305939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:41.344785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.345513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.345770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.346120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.346826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.349070 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.485793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1258/2486] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:41 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:41.489770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.501373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039b4b9-92ce-40a6-a950-aded9116ab8f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.505988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.506653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.509162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.509162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.509162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.509820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.522352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1229/2487] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:41.526117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.536757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83255fe9-b4b7-4a13-8aec-d86d445efc4c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.541658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.546739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.546739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.546739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] PATH_INFO: `/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843/users/00e2191a7d264cd4a218569c3300e7b4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.558783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc00fa8e0a04d9582a8d377bbabe843, user_id=00e2191a7d264cd4a218569c3300e7b4, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.562577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.646562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1259/2488] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:41 2022] PUT /identity/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843/users/00e2191a7d264cd4a218569c3300e7b4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:41.650617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.663557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c26c7e-7c18-4882-9da6-a2e72894498a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.689711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:41.722731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.723606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.723750 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.723983 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.724707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.726380 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871a282-ff51-4f54-afb0-4dec7c901132 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.737933 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1230/2489] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:41.741772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.752780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6a076-5df3-490d-8d9b-2049ea6b7487 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.757426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.758305 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.758585 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.758943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] PATH_INFO: `/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843/users/00e2191a7d264cd4a218569c3300e7b4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.760994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc00fa8e0a04d9582a8d377bbabe843, user_id=00e2191a7d264cd4a218569c3300e7b4, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.764336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.775256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1260/2490] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:41 2022] PUT /identity/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843/users/00e2191a7d264cd4a218569c3300e7b4/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:41.786422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.786776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.787145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.814937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] MFA Rules not processed for user `00e2191a7d264cd4a218569c3300e7b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:41.816159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:41.886226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1231/2491] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:41 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:41.897950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:41.899633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:41.961479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f340593-cd37-4370-af59-2ab9c1ea1442 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:41.965697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:41.966953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:41.967240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:41.967518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:41.977959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:41.979405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:41.989271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1261/2492] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:41 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:42.089386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:42.091448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:42.103549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d62cdd-a563-4289-be11-9f2a325d51a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:42.107155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:42.107802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:42.112405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:42.112405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:42.183482 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:42.185669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:42.196308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1232/2493] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:44.708060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:44.709699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:44.795183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8703bf-8a23-4b11-b841-fdebab4d4de6 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:44.799678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:44.800549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:44.806737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:44.806737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] PATH_INFO: `/v3/users/858da270173c4944ab3c7829bd698c4a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:44.806737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858da270173c4944ab3c7829bd698c4a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:44.806737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:44.826243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:45.034507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858da270173c4944ab3c7829bd698c4a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.136555 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858da270173c4944ab3c7829bd698c4a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.149001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858da270173c4944ab3c7829bd698c4a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.149653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858da270173c4944ab3c7829bd698c4a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.157473 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-c2a738e3-5017-41ac-a122-1675f87de788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858da270173c4944ab3c7829bd698c4a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.164008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1262/2494] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:44 2022] DELETE /identity/v3/users/858da270173c4944ab3c7829bd698c4a => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:45.452700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:45.465469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764690cf-2876-42ea-80e3-2bd9a20734ce service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:45.515084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:45.528259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:45.529278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:45.529560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:45.529837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] PATH_INFO: `/v3/projects/fcfb19bc4a754f46b026416f24964eb9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:45.531225 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcfb19bc4a754f46b026416f24964eb9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:45.533329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:45.656751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcfb19bc4a754f46b026416f24964eb9', 'request_id': 'req-b6f04f4d-c485-44b9-916b-23530a3a2235'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.730863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcfb19bc4a754f46b026416f24964eb9', 'request_id': 'req-b6f04f4d-c485-44b9-916b-23530a3a2235'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.748259 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcfb19bc4a754f46b026416f24964eb9', 'request_id': 'req-b6f04f4d-c485-44b9-916b-23530a3a2235'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.755033 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] The token cache is being invalidate because project fcfb19bc4a754f46b026416f24964eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:45.755320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.755988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b6f04f4d-c485-44b9-916b-23530a3a2235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:45.757548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1233/2495] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:45 2022] DELETE /identity/v3/projects/fcfb19bc4a754f46b026416f24964eb9 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:45.762353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:45.763617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:45.763617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:45.781939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:45.783117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:45.842559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1263/2496] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:45.850919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:45.851238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:45.851512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:45.870449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:45.871780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:45.880581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1234/2497] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:45.884714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:45.895071 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aef337-d82d-43e7-b10e-aa6ffa9f232b None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:45.899714 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:45.900361 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:45.900645 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:45.900921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:45.901681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:45.901986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:45.903716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:45.915294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1264/2498] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:45.919807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:45.929187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b222e-4440-48c5-b2cc-de089c7a90d8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:45.934247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:45.935419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:45.935780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:45.935966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:45.936665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:45.938602 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.063537 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1235/2499] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:45 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:46.067615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.077911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfbc07-be6d-4971-b367-4282dd01b4cf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.135503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.136177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.136461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.136730 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.137477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.139574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.218944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1265/2500] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:46 2022] POST /identity/v3/users => generated 282 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:46.224243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.236557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f64c8d-ebe6-414b-9f2a-b837d525a674 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.246953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.246953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.246953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.246953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.247318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.247318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.256139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1236/2501] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:46.260276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.271810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04cd8a-e4a1-4a04-8df3-da236b1fd0db admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.276525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.277336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.277623 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.277937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.278752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.280333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d5641-3dfb-4f1f-9200-daf6ccd0d4ff admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.290273 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1266/2502] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:46.295120 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.305417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374e915-f3d1-4388-b5a7-bb0b29deca03 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.310815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.311698 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.311994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.312267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] PATH_INFO: `/v3/projects/55eb41b57a7741079535d923bdfe2359/users/fcd9ce3df7c94777b624a128db5db98a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.327665 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55eb41b57a7741079535d923bdfe2359, user_id=fcd9ce3df7c94777b624a128db5db98a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.330434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.423048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1237/2503] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:46 2022] PUT /identity/v3/projects/55eb41b57a7741079535d923bdfe2359/users/fcd9ce3df7c94777b624a128db5db98a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:46.433465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.433760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.434042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.444147 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:46.469903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] MFA Rules not processed for user `fcd9ce3df7c94777b624a128db5db98a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:46.471155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:46.540298 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1267/2504] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:46.545707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.608490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3dc6f-74e1-47fc-a39d-300ddec706a5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.613096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.613786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.614069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.614346 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.615047 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.616930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.719783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:46.727234 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1238/2505] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:46 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:46.731505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.743292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc6ff-992d-43f7-a790-2be5e7a488da None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.808775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.808775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.808775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.808775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.809661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.809661 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.901806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1268/2506] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:46 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:46.906518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.916787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24bf520-d033-4e64-95a1-b77d96d196d3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.922443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.923146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.923430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.923818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.924554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.926169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:46.939814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1239/2507] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:46.945270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:46.956177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91dd156-cf8b-4bfc-8662-df00db974ea8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:46.960991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:46.961896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:46.962183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:46.962449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] PATH_INFO: `/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae/users/e115eb950cd54651859825b9e2223bca/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:46.979036 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb49ea4ee554e1eb587014bb77cfeae, user_id=e115eb950cd54651859825b9e2223bca, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:46.982975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:47.050535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1269/2508] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:46 2022] PUT /identity/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae/users/e115eb950cd54651859825b9e2223bca/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:47.054611 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:47.066195 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6d598-ee2d-441c-9565-6ebc362fbffa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:47.125693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:47.126365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:47.126662 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:47.126926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:47.127693 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:47.129303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd143417-4bee-459b-bf8c-9ddb2a444cd5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:47.140065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1240/2509] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:47.144363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:47.155678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc7874-6500-4f08-ac0f-d3edb258be63 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:47.160484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:47.161587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:47.161723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:47.161953 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] PATH_INFO: `/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae/users/e115eb950cd54651859825b9e2223bca/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:47.164527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fb49ea4ee554e1eb587014bb77cfeae, user_id=e115eb950cd54651859825b9e2223bca, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:47.167180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:47.178755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1270/2510] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:47 2022] PUT /identity/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae/users/e115eb950cd54651859825b9e2223bca/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:47.191163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:47.211416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:47.211416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:47.220978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] MFA Rules not processed for user `e115eb950cd54651859825b9e2223bca`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:47.222266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:47.298453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1241/2511] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:47 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:47.389997 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:47.392236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:47.445980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:47.451750 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1d0b4-3785-45f0-8d17-753eda8fca71 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:47.455382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:47.456024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:47.456311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:47.456589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:47.465968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:47.467409 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c5fdef-c76e-4e9e-975f-6abe35ffbcd6 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:47.476642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1271/2512] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:47 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:47.604954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:47.606612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:47.700606 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29b22e-53b5-4c12-bda2-7b0eef63d92c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:47.705922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:47.706800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:47.707083 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:47.707386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] PATH_INFO: `/v3/users/2c2935332eda4f809e47c9724e99c682` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:47.708597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2935332eda4f809e47c9724e99c682)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:47.710548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:47.721490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:47.894808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2935332eda4f809e47c9724e99c682'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:47.977331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2935332eda4f809e47c9724e99c682'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:47.978359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2935332eda4f809e47c9724e99c682'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:47.996049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2935332eda4f809e47c9724e99c682'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.004126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2935332eda4f809e47c9724e99c682'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.010767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1242/2513] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:47 2022] DELETE /identity/v3/users/2c2935332eda4f809e47c9724e99c682 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:48.015380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:48.015924 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:48.016035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:48.034397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:48.035591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.096552 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1272/2514] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:48.106298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:48.108315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.171855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702eaf-1a68-44a1-a51c-5381d8aeaf5e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:48.175563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:48.176211 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:48.176503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:48.176782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:48.187807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:48.189281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:48.199135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1243/2515] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:48.542129 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:48.544606 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.557244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301d6cf-baf0-4f01-ab22-c45f3a2f6844 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:48.564650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:48.564650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:48.564650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:48.564650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] PATH_INFO: `/v3/users/fcd9ce3df7c94777b624a128db5db98a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:48.565261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd9ce3df7c94777b624a128db5db98a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:48.567166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:48.659329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:48.660916 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.675139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84014465-4222-4c96-add2-60856329c5e1 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:48.680667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:48.681863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:48.682381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:48.682741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] PATH_INFO: `/v3/projects/4c4321a125c441fbaa69c04d7f63c4ac` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:48.684048 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4321a125c441fbaa69c04d7f63c4ac)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:48.686678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:48.761397 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd9ce3df7c94777b624a128db5db98a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.792631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4321a125c441fbaa69c04d7f63c4ac', 'request_id': 'req-ec75bf00-7056-4489-a31e-c42e2cbdd37f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.861051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd9ce3df7c94777b624a128db5db98a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.874656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd9ce3df7c94777b624a128db5db98a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.875370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd9ce3df7c94777b624a128db5db98a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.884040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-07d2dc85-23c2-493f-b65c-1fad9edff033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd9ce3df7c94777b624a128db5db98a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.890055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1273/2516] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:48 2022] DELETE /identity/v3/users/fcd9ce3df7c94777b624a128db5db98a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:48.894598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:48.894880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:48.895153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:48.913084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:48.914261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.953263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4321a125c441fbaa69c04d7f63c4ac', 'request_id': 'req-ec75bf00-7056-4489-a31e-c42e2cbdd37f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.959993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4321a125c441fbaa69c04d7f63c4ac', 'request_id': 'req-ec75bf00-7056-4489-a31e-c42e2cbdd37f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.974449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] The token cache is being invalidate because project 4c4321a125c441fbaa69c04d7f63c4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:48.974744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.975397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:48.976954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1244/2517] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:48 2022] DELETE /identity/v3/projects/4c4321a125c441fbaa69c04d7f63c4ac => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:48.977415 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1274/2518] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:48.980957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:48.985207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.993497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:48.994891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:48.997467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:49.000345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:49.050248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75bf00-7056-4489-a31e-c42e2cbdd37f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:49.052308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b6b85-60e1-436a-afdd-f71021382174 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:49.056060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:49.056447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:49.056706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:49.056987 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:49.057308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:49.057424 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:49.057790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:49.058176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] PATH_INFO: `/v3/users/00e2191a7d264cd4a218569c3300e7b4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:49.059412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:49.060142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e2191a7d264cd4a218569c3300e7b4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:49.063121 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:49.077813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:49.077813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:49.093052 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1275/2519] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:49.270243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e2191a7d264cd4a218569c3300e7b4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.368441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e2191a7d264cd4a218569c3300e7b4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.369389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e2191a7d264cd4a218569c3300e7b4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.387141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e2191a7d264cd4a218569c3300e7b4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.394768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e2191a7d264cd4a218569c3300e7b4'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.401190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1245/2520] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:48 2022] DELETE /identity/v3/users/00e2191a7d264cd4a218569c3300e7b4 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:49.504180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:49.505642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:49.518411 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f243bf-927f-4fc5-8465-2f555f56c355 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:49.580249 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:49.581153 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:49.581434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:49.581709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] PATH_INFO: `/v3/projects/55eb41b57a7741079535d923bdfe2359` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:49.582896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55eb41b57a7741079535d923bdfe2359)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:49.584845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:49.731051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55eb41b57a7741079535d923bdfe2359', 'request_id': 'req-f36049e7-7355-407d-a766-ab42d9bb9451'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.821460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55eb41b57a7741079535d923bdfe2359', 'request_id': 'req-f36049e7-7355-407d-a766-ab42d9bb9451'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.828967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55eb41b57a7741079535d923bdfe2359', 'request_id': 'req-f36049e7-7355-407d-a766-ab42d9bb9451'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.839323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] The token cache is being invalidate because project 55eb41b57a7741079535d923bdfe2359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:49.839605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.840232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:49.841798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1276/2521] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:49 2022] DELETE /identity/v3/projects/55eb41b57a7741079535d923bdfe2359 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:49.845955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:49.847496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:49.860677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51440420-81f8-4151-a7eb-a8c40569bc85 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:49.918790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:49.919839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:49.928686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:49.928686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] PATH_INFO: `/v3/users/e115eb950cd54651859825b9e2223bca` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:49.929083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:49.929201 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e115eb950cd54651859825b9e2223bca)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:49.929308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:49.929399 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:49.946899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36049e7-7355-407d-a766-ab42d9bb9451 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:49.957739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:49.957739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:49.957739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:49.957739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] PATH_INFO: `/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:49.958125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc00fa8e0a04d9582a8d377bbabe843)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:49.960282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.166038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:50.170192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:50.179172 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e115eb950cd54651859825b9e2223bca'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.179776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc00fa8e0a04d9582a8d377bbabe843', 'request_id': 'req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.267337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e115eb950cd54651859825b9e2223bca'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.267958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e115eb950cd54651859825b9e2223bca'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.280951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e115eb950cd54651859825b9e2223bca'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.287988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d1ea20ab-0d8f-4ad8-9fa7-f01e5ae84454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e115eb950cd54651859825b9e2223bca'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.294586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1246/2522] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:49 2022] DELETE /identity/v3/users/e115eb950cd54651859825b9e2223bca => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:50.324163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc00fa8e0a04d9582a8d377bbabe843', 'request_id': 'req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.331726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc00fa8e0a04d9582a8d377bbabe843', 'request_id': 'req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.348044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] The token cache is being invalidate because project cdc00fa8e0a04d9582a8d377bbabe843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:50.348044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.348044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a46b6cbd-44a9-4afa-bb95-3aacf17c8752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.350284 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1277/2523] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:49 2022] DELETE /identity/v3/projects/cdc00fa8e0a04d9582a8d377bbabe843 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:50.355127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.355417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.355694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.378077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:50.379534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:50.447986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1247/2524] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:50.455736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.456339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.456622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.476520 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:50.477822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:50.486642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1278/2525] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:50.494244 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.504265 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a7fb2-35c7-471e-b821-64e81d0b4a00 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.509969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.511062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.511062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.511323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.512014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:50.512326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.513964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.530113 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1248/2526] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:50.533939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.541591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd8ddf2-d5f6-41b0-ade7-3ec301f82379 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.548545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.549267 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.549558 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.549887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.550607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.552806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.651695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1279/2527] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:50 2022] POST /identity/v3/projects => generated 393 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:50.657108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.667142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7707fc5-4d8a-46a9-9c86-9d96d424dcee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.728687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.729407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.729748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.730029 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.730737 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.733485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.760734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.763485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:50.776711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd1270-10c6-4c09-81da-817bc1195b77 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.783115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.784233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.784764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.785265 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] PATH_INFO: `/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.786765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fb49ea4ee554e1eb587014bb77cfeae)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.789201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.826125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1249/2528] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:50 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:50.827307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.837096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b3f0f-22a4-402b-a944-e0a6219a99cd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.842951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.843618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.843907 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.844192 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.844920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.846545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.864127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1250/2529] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:50.864127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.870373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ee125-4b7b-4583-94b7-6ccb1d1b1381 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.877056 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.877320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.877616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.877968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.878730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.880340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.891796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1251/2530] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:50.895722 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:50.905945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1875a66-000f-4c22-b2e4-074b8cfeb515 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:50.923353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fb49ea4ee554e1eb587014bb77cfeae', 'request_id': 'req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:50.968427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:50.969411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:50.969909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:50.970366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] PATH_INFO: `/v3/projects/bc1f3c59727c4cca8c92451826276009/users/ace3c96509c5417998b7a550dc64857f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:50.972431 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:50.987175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1f3c59727c4cca8c92451826276009, user_id=ace3c96509c5417998b7a550dc64857f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:50.989924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f871803-f0f0-4452-9fe9-967fdafcbc30 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:50.999034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fb49ea4ee554e1eb587014bb77cfeae', 'request_id': 'req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:51.006221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fb49ea4ee554e1eb587014bb77cfeae', 'request_id': 'req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:51.017528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] The token cache is being invalidate because project 0fb49ea4ee554e1eb587014bb77cfeae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:51.017817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:51.018466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-106f739d-c1f8-4570-bfc0-1a7dc9c61aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:51.020157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1280/2531] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:50 2022] DELETE /identity/v3/projects/0fb49ea4ee554e1eb587014bb77cfeae => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:51.024865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4f8e5-599f-41fa-b682-62e3ca6a7f15 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.025200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4f8e5-599f-41fa-b682-62e3ca6a7f15 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.025515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a4f8e5-599f-41fa-b682-62e3ca6a7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.045006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a8a4f8e5-599f-41fa-b682-62e3ca6a7f15 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:51.046231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a8a4f8e5-599f-41fa-b682-62e3ca6a7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.054184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1281/2532] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:51.062077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.066497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.066622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1252/2533] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:50 2022] PUT /identity/v3/projects/bc1f3c59727c4cca8c92451826276009/users/ace3c96509c5417998b7a550dc64857f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:51.066761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.075992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.076430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.076711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.083842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:51.085059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.103541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] MFA Rules not processed for user `ace3c96509c5417998b7a550dc64857f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:51.104753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.146233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1282/2534] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:51.150391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.159484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c9ec07-27fa-4a6f-af6f-14da2bf481e9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.164268 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.164911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.165221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.165498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.166213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:51.166744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.168335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.169754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:51.173604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1253/2535] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:51.178232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.179574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.180955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1283/2536] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:32:51.187982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.193353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa6357-817f-40a8-9017-a87431bd42ea None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.197777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d17a6-22a0-4d5f-bfc0-41c360bc1f56 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.198055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.198746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.199068 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.199348 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.200058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.202568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.203534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.204185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.204489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.204726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.205474 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.207871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.324695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1284/2537] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:51.324929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1254/2538] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:51.326283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.326823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.388557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:51.389780 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d5927-002b-4a14-a280-84d445664d02 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.392300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f8d6-35f2-485e-ad6d-c412885edb3d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.394519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.395231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.395508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.395778 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.396548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.397599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.398328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.398582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.398704 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.398879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.399568 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.401510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.517815 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1255/2539] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:51.518022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1285/2540] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/users => generated 303 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:51.522090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.522221 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.532105 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596ec5-4687-49c8-ae60-ad86fce07107 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.533609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a768d9-0e6a-482e-8544-972f4f9c64f7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.537205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.537862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.538169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.538273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.538475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.538863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.539143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.539264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.539500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.540213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.540716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.541866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.551512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1286/2541] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:51.554490 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1256/2542] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:51.555727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.558302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.566146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d875c-957e-4472-b061-9e4556c56d1d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.568919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19add049-5b6c-499c-a016-41fc55a0b1f2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.570701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.571584 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.571850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.572125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] PATH_INFO: `/v3/projects/5907894bd9c14b86a410ed732ccb6b98/users/d8b6f0b1f0fe443c8f83ad53411d3b1e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.573802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.574627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.574912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.576041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.577046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.578637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.586832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5907894bd9c14b86a410ed732ccb6b98, user_id=d8b6f0b1f0fe443c8f83ad53411d3b1e, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.592727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1257/2543] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:51.592902 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.594099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.603647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbc04f-c76c-456a-a5ab-c01c3cb6c3e7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.609780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.610647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.612597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.612597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] PATH_INFO: `/v3/projects/2048d6b6371b4e2998eebe13be1287de/users/9f2fdd68b04844248e3ed0eefab09b2c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.625816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2048d6b6371b4e2998eebe13be1287de, user_id=9f2fdd68b04844248e3ed0eefab09b2c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.628438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.667509 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1287/2544] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:51 2022] PUT /identity/v3/projects/5907894bd9c14b86a410ed732ccb6b98/users/d8b6f0b1f0fe443c8f83ad53411d3b1e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:51.668338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.669925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.724756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1258/2545] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:51 2022] PUT /identity/v3/projects/2048d6b6371b4e2998eebe13be1287de/users/9f2fdd68b04844248e3ed0eefab09b2c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:51.725717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.732094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db7bf-9310-4e5a-aea7-135bcffba8d4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.763138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:51.789785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.790660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.790943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.791220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] PATH_INFO: `/v3/users/8f822962d77f449b89c00c6c6952ea16` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.792422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f822962d77f449b89c00c6c6952ea16)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.794400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.795911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b19b42-8e35-41c2-83d0-004d4e60bf0f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.800641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.801333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.801617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.801891 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.802652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.804227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb01509-b818-45a2-9bbc-b38da9fdd3f2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.817875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1259/2546] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:51.817875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.817875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.817875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.843742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] MFA Rules not processed for user `9f2fdd68b04844248e3ed0eefab09b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:51.844962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:51.908087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1260/2547] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:51.908832 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.918843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f951e83-9f35-4c69-a76d-d2a268b940b1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:51.923519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:51.926318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:51.926318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:51.926318 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] PATH_INFO: `/v3/projects/5907894bd9c14b86a410ed732ccb6b98/users/d8b6f0b1f0fe443c8f83ad53411d3b1e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:51.927131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5907894bd9c14b86a410ed732ccb6b98, user_id=d8b6f0b1f0fe443c8f83ad53411d3b1e, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:51.929567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:51.941843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1261/2548] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:51 2022] PUT /identity/v3/projects/5907894bd9c14b86a410ed732ccb6b98/users/d8b6f0b1f0fe443c8f83ad53411d3b1e/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:51.942760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:51.961974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:51.989951 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f822962d77f449b89c00c6c6952ea16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:52.018269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909706df-5234-4f1b-91a1-02a0bbd1689d admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.022823 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.023700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.023986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.024260 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.024951 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.026874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1943e3-1c64-4173-96cd-e670e60624e2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.066610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f822962d77f449b89c00c6c6952ea16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:52.080446 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f822962d77f449b89c00c6c6952ea16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:52.081291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f822962d77f449b89c00c6c6952ea16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:52.088760 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-a00c0119-bef8-42b4-a15e-0e5a8ecdc0aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f822962d77f449b89c00c6c6952ea16'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:52.095629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1288/2549] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:51 2022] DELETE /identity/v3/users/8f822962d77f449b89c00c6c6952ea16 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:52.096950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.097396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.097822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.116721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1262/2550] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:51 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:52.121171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.121517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.121857 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.129295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] MFA Rules not processed for user `d8b6f0b1f0fe443c8f83ad53411d3b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:52.130865 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.140498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:52.142246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.203757 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1289/2551] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:52.204334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1263/2552] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:52.207679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.208984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.215321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.216959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.222626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4ed30f-45c6-48c7-ab50-e68ed7428400 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.227238 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.227905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.228191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.228464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.229186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.231497 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.276915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f60b4-72fc-42c6-86f4-ba18a79f78a5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.281312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.281957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.282237 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.282512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.291442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.293721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.302313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1264/2553] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:52.303176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.304495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.331920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1290/2554] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:52 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:52.336173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.358538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c1a45-63cd-44bf-b503-d2ad814ca84b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.366025 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:52.368003 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.369689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.370228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.370514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.371543 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.373456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.387536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8fcffb-f222-4e57-871c-17aaeb391029 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.392336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1291/2555] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:52.392946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.393872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.394302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.394842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.396831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.407177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.408882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.409559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407435e2-f304-43bd-a9a8-1c69e4ab9490 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.421219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] PATH_INFO: `/v3/projects/eace03e229bb4c36b327670e369ff74e/users/92b7641ad9c344ce93289731873fb265/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.421574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1265/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:52.421654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:52.433046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eace03e229bb4c36b327670e369ff74e, user_id=92b7641ad9c344ce93289731873fb265, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.435745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.473202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.474618 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.486089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec2f508-3e34-4599-80a2-256908d87f06 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.489908 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.493884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.493884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.493884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.493884 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.532622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1292/2557] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:52 2022] PUT /identity/v3/projects/eace03e229bb4c36b327670e369ff74e/users/92b7641ad9c344ce93289731873fb265/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:52.536569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.564423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.565923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.582528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1266/2558] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:52.606947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8a61-5406-4108-a469-f6553a443770 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.612292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.613053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.613341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.613619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.614489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.616102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f962-6064-44b1-8901-9078d68a9c1d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.629465 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1293/2559] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:32:52.633837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.646439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce917e1-9169-4c61-9424-18d1299e3159 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.652728 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.654441 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.654804 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.655090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] PATH_INFO: `/v3/projects/eace03e229bb4c36b327670e369ff74e/users/92b7641ad9c344ce93289731873fb265/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.657481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eace03e229bb4c36b327670e369ff74e, user_id=92b7641ad9c344ce93289731873fb265, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.660297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.674114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1267/2560] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:52 2022] PUT /identity/v3/projects/eace03e229bb4c36b327670e369ff74e/users/92b7641ad9c344ce93289731873fb265/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:52.685086 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.685979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.686342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.721699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] MFA Rules not processed for user `92b7641ad9c344ce93289731873fb265`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:52.722829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.805700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1294/2561] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:52 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:52.812708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.814849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:52.819133 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:52.891405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9ceb6-026f-40ec-a2a7-da409d032592 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.896024 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.896745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.897045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.897432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.903768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c751c-4df8-4454-999c-6c8e28bce6ee admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:52.908367 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.908817 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:52.909792 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:52.910005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e5a04-3707-488c-844d-86a38c3b1a77 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.910139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:52.910419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] PATH_INFO: `/v3/projects/48cdc8aa097c48e5985029243529ca93` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:52.911658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] RBAC: Authorizing `identity:delete_project(project_id=48cdc8aa097c48e5985029243529ca93)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:52.913597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:52.920874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1295/2562] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:52 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:53.071731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48cdc8aa097c48e5985029243529ca93', 'request_id': 'req-5415dd1f-78fb-463c-8a38-24edf841484e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:53.142006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48cdc8aa097c48e5985029243529ca93', 'request_id': 'req-5415dd1f-78fb-463c-8a38-24edf841484e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:53.148308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48cdc8aa097c48e5985029243529ca93', 'request_id': 'req-5415dd1f-78fb-463c-8a38-24edf841484e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:53.158963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:53.165098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] The token cache is being invalidate because project 48cdc8aa097c48e5985029243529ca93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:53.165389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:53.166086 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:53.172054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1268/2563] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:52 2022] DELETE /identity/v3/projects/48cdc8aa097c48e5985029243529ca93 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:53.176254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524e3b-bb2b-4dec-8abb-f1e03e751275 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.176254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524e3b-bb2b-4dec-8abb-f1e03e751275 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.176254 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524e3b-bb2b-4dec-8abb-f1e03e751275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.191375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.192960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:53.194967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-df524e3b-bb2b-4dec-8abb-f1e03e751275 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:53.196260 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df524e3b-bb2b-4dec-8abb-f1e03e751275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:53.200970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:53.260020 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415dd1f-78fb-463c-8a38-24edf841484e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.262454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1296/2564] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:53.263624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.264370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.264560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.264834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.266930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:53.270914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.271202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.274576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.302748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:53.302748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:53.312589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1297/2565] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:53.317396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.329008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12683f42-744c-4bf8-8d1a-11f920e81d66 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.334287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.334952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.335240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.335590 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.336521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:53.337122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.338945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.353201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1298/2566] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:53.355202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.356743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.358406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.370443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1269/2567] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:53.371102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f607e-a80f-4ce7-a8a1-7b9ae48f5b6d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.377967 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.378923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.379899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.379899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.380538 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.382640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.492079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1299/2568] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:53 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:53.496389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.507529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aa3c4-c6a8-4741-988f-0e819a341bde service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.570803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.571640 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.571994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.572458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.573209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.575161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.667100 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1270/2569] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:53 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:53.668294 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.679783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e5bf8-add0-4859-b3ea-94a6f8a0ef56 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.684630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.685364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.687290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.687290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.687290 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.688418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.699353 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1300/2570] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:53.703799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.717298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70f1bb4-e6a7-4b88-9874-86f2aaba7c92 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.721551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.722215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.722533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.722847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.723547 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.725150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64158f8b-2583-48a8-bbc2-7f52e4541dff admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.739238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1271/2571] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:53.741992 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:53.754457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4f1f0-0077-4f55-b614-eb53e34faa13 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:53.761762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:53.765422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.769458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.769849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] PATH_INFO: `/v3/projects/4eb542c9c4974b58a918e62644f44796/users/17603dd682c1417f9ae662d7c660146f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:53.798665 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eb542c9c4974b58a918e62644f44796, user_id=17603dd682c1417f9ae662d7c660146f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:53.802694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:53.909479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1301/2572] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:53 2022] PUT /identity/v3/projects/4eb542c9c4974b58a918e62644f44796/users/17603dd682c1417f9ae662d7c660146f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:53.980742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:53.981242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:53.981388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:54.008137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] MFA Rules not processed for user `17603dd682c1417f9ae662d7c660146f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:54.009385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:54.031292 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:54.065589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:54.067629 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:54.075561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1272/2573] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:54.087112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:54.134300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7192c3-fb9d-4e8e-a2c7-8cfcb93e7beb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:54.139488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:54.140559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:54.140918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:54.141229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] PATH_INFO: `/v3/users/113a994360c24b90993e56171bb1204b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:54.142453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=113a994360c24b90993e56171bb1204b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:54.142976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479706d-edc3-4042-beda-8ee9364d67b2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:54.144374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:54.146806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:54.147469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:54.147924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:54.149407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:54.158368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:54.159796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22731f5-c09c-4bdd-8790-cfeae90c281c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:54.168814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1273/2574] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:54.306283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:54.315929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113a994360c24b90993e56171bb1204b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:54.382166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113a994360c24b90993e56171bb1204b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:54.401098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113a994360c24b90993e56171bb1204b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:54.401844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113a994360c24b90993e56171bb1204b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:54.410378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113a994360c24b90993e56171bb1204b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:54.415442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1302/2575] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:54 2022] DELETE /identity/v3/users/113a994360c24b90993e56171bb1204b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:54.420527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:54.421044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:54.421415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:54.439655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:54.440925 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:54.504601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1274/2576] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:54.515889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:54.516113 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:54.573721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc683b-8c1c-42fe-b0e4-25ab1105ac1f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:54.577489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:54.578136 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:54.578427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:54.578702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:54.587687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:54.589408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:54.602017 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1303/2577] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:54.988962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:54.990434 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:55.005510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bcd2f9-5dd5-4142-8a33-25947d2915d9 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:55.012067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:55.012973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:55.013350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:55.014214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] PATH_INFO: `/v3/projects/d86ebdd467ba43a0bbac6a95a38d9443` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:55.015723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86ebdd467ba43a0bbac6a95a38d9443)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:55.018098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:55.119544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86ebdd467ba43a0bbac6a95a38d9443', 'request_id': 'req-7b349d70-9301-4719-a213-7be27259b6ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.192683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86ebdd467ba43a0bbac6a95a38d9443', 'request_id': 'req-7b349d70-9301-4719-a213-7be27259b6ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.198027 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:55.201254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86ebdd467ba43a0bbac6a95a38d9443', 'request_id': 'req-7b349d70-9301-4719-a213-7be27259b6ac'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.215940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] The token cache is being invalidate because project d86ebdd467ba43a0bbac6a95a38d9443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:55.216229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.217058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.218621 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1275/2578] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:54 2022] DELETE /identity/v3/projects/d86ebdd467ba43a0bbac6a95a38d9443 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:55.222648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:55.233437 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b55fb-facd-4862-9cbb-1206fcee899f service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:55.301291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:55.302199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:55.306602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:55.306602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] PATH_INFO: `/v3/users/e5f695779a7e4b398cde0f26837a3131` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:55.306602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5f695779a7e4b398cde0f26837a3131)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:55.306602 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:55.572687 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5f695779a7e4b398cde0f26837a3131'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.627756 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5f695779a7e4b398cde0f26837a3131'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.630208 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:55.645810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5f695779a7e4b398cde0f26837a3131'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.647031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5f695779a7e4b398cde0f26837a3131'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.657915 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5eb91a96-8344-412a-9799-e9cfe9f8f29e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5f695779a7e4b398cde0f26837a3131'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:55.662741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1304/2579] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:55 2022] DELETE /identity/v3/users/e5f695779a7e4b398cde0f26837a3131 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:56.070005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.072050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:56.088376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b349d70-9301-4719-a213-7be27259b6ac admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.155755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.156560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.156873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.157155 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] PATH_INFO: `/v3/projects/c006ba7ca3204c20b11d6868ddd96810` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.158751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c006ba7ca3204c20b11d6868ddd96810)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.160650 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.279838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c006ba7ca3204c20b11d6868ddd96810', 'request_id': 'req-20d920f2-e79a-4353-a173-39c10b62cb51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:56.386385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c006ba7ca3204c20b11d6868ddd96810', 'request_id': 'req-20d920f2-e79a-4353-a173-39c10b62cb51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:56.392763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c006ba7ca3204c20b11d6868ddd96810', 'request_id': 'req-20d920f2-e79a-4353-a173-39c10b62cb51'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:56.404044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] The token cache is being invalidate because project c006ba7ca3204c20b11d6868ddd96810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:56.404274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:56.404900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20d920f2-e79a-4353-a173-39c10b62cb51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:56.406532 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1276/2580] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:56 2022] DELETE /identity/v3/projects/c006ba7ca3204c20b11d6868ddd96810 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:56.411577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.412093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.412261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.430733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:56.431914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:56.492405 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1305/2581] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:56.501233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.508540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.508540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.520340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:56.521567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:56.529628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1277/2582] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:56.533872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.543440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2065a-0b12-4696-ad94-7ff14ef58569 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.548922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.549607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.549896 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.554490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.554490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:56.554490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.554490 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.565306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1306/2583] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:56.569747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.579279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf646bc-70d6-45d7-8025-e9a9cac41b6e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.584011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.584669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.584950 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.585270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.586054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.587981 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.678011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1278/2584] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:56 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:56.679205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.690336 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80951a2-55d3-400f-b391-e76954710eb2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.747276 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.747943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.748225 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.748500 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.749890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.751836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.850809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1307/2585] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:56 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:56.854992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.866683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0ca3d-8514-4677-baed-7f2ad6493f37 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.871419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.873751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.873751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.873751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.873751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.875466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.889069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1279/2586] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:56.890395 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.900783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe250a8b-e310-4176-bd88-a680bb866505 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.906770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.907452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.907745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.908030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.908771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.910427 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.926525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1308/2587] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:56.935315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.939009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:56.940993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:56.941171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472ce38d-ffb9-48ed-ab84-9a5a4d935354 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.945897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.947034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.947416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.947791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] PATH_INFO: `/v3/projects/c7de2d1910bf4474ba7d9f3dab1cd081/users/c06ac32542dc4baebf5fb94906a7148b/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.959930 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eef23-d9e4-4b74-8470-3de4fd249375 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:56.965176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7de2d1910bf4474ba7d9f3dab1cd081, user_id=c06ac32542dc4baebf5fb94906a7148b, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.966005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:56.966883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:56.967173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:56.969131 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] PATH_INFO: `/v3/users/9f2fdd68b04844248e3ed0eefab09b2c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:56.971942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532620a1-295a-49df-94b9-f481cb102215 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:56.972080 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2fdd68b04844248e3ed0eefab09b2c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:56.972692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.056159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1280/2588] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:56 2022] PUT /identity/v3/projects/c7de2d1910bf4474ba7d9f3dab1cd081/users/c06ac32542dc4baebf5fb94906a7148b/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:57.067580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719679-5779-443b-a892-6067d672f999 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.067868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719679-5779-443b-a892-6067d672f999 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.068145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4719679-5779-443b-a892-6067d672f999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.094485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-f4719679-5779-443b-a892-6067d672f999 None None] MFA Rules not processed for user `c06ac32542dc4baebf5fb94906a7148b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:57.095686 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f4719679-5779-443b-a892-6067d672f999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.099595 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:57.160400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1281/2589] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:32:57.165202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719679-5779-443b-a892-6067d672f999 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.198045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:57.209348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2fdd68b04844248e3ed0eefab09b2c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.229717 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4719679-5779-443b-a892-6067d672f999 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.234677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.235469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.236061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.236408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.237212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.239101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b2f4-0690-491f-801f-ee1e804ba190 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.272179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2fdd68b04844248e3ed0eefab09b2c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.285325 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2fdd68b04844248e3ed0eefab09b2c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.286012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2fdd68b04844248e3ed0eefab09b2c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.292761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2fdd68b04844248e3ed0eefab09b2c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.298622 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1309/2590] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:56 2022] DELETE /identity/v3/users/9f2fdd68b04844248e3ed0eefab09b2c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:57.317307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.317307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.357558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1282/2591] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:32:57.357558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.357558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.357558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.365121 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acacb66-041a-4019-8c4b-653a2e430ecd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.375604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:57.376852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.422765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.423650 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.423929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.424199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] PATH_INFO: `/v3/users/17603dd682c1417f9ae662d7c660146f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.425627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17603dd682c1417f9ae662d7c660146f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.427819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.438080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1283/2592] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:57.439730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.441660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.454685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d584-a3d9-49ac-bc9a-8198861ad99f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.459485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.460241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.460525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.460805 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.461549 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.463446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.525787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1284/2593] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:57.526763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.532988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.584291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdee809-4852-45bc-a058-370326de26f7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.592448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.593888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.594179 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.594454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.603578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.605002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.615444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1285/2594] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:57.616243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.625357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5220e8-77ee-499a-a7d5-eae0caa3ed11 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.627056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17603dd682c1417f9ae662d7c660146f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.630825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.631560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.631843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.632257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.632987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.634601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.645118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1286/2595] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:57.645934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.647584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.660776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff930f73-3149-4b0a-a095-5026f68b5ef5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.665505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.666384 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.666683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.666937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] PATH_INFO: `/v3/users/ace3c96509c5417998b7a550dc64857f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.668127 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace3c96509c5417998b7a550dc64857f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.670081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.675094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:57.695666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17603dd682c1417f9ae662d7c660146f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.708843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17603dd682c1417f9ae662d7c660146f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.709773 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17603dd682c1417f9ae662d7c660146f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.716996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17603dd682c1417f9ae662d7c660146f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.723508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1310/2596] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:57 2022] DELETE /identity/v3/users/17603dd682c1417f9ae662d7c660146f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:57.724271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.725614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.788979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5468bb-01ff-4dca-a58e-697d461037d3 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:57.793675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:57.794559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.794843 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.795117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] PATH_INFO: `/v3/projects/389c45f9f7ea4721b001f7268cd4aa57/users/2475b8af712540398018419e345a6992/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.805455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:57.812455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c45f9f7ea4721b001f7268cd4aa57, user_id=2475b8af712540398018419e345a6992, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:57.815179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e0512-6c23-439b-b378-6095259cff16 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:57.840867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace3c96509c5417998b7a550dc64857f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.908419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1311/2597] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:57 2022] PUT /identity/v3/projects/389c45f9f7ea4721b001f7268cd4aa57/users/2475b8af712540398018419e345a6992/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:57.909978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc56-3318-4058-8820-b6a8756a7101 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.910321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc56-3318-4058-8820-b6a8756a7101 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.910697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c119bc56-3318-4058-8820-b6a8756a7101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:57.928151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c119bc56-3318-4058-8820-b6a8756a7101 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:57.929859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c119bc56-3318-4058-8820-b6a8756a7101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.934069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace3c96509c5417998b7a550dc64857f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.934069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace3c96509c5417998b7a550dc64857f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.945914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace3c96509c5417998b7a550dc64857f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.957166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace3c96509c5417998b7a550dc64857f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:57.966052 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1287/2598] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:57 2022] DELETE /identity/v3/users/ace3c96509c5417998b7a550dc64857f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:57.966969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:57.969565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:57.996393 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1312/2599] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:57.997944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359830-d80a-4640-b294-b73765428fe9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:57.998224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359830-d80a-4640-b294-b73765428fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:57.998498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67359830-d80a-4640-b294-b73765428fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.019005 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-67359830-d80a-4640-b294-b73765428fe9 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:58.020240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-67359830-d80a-4640-b294-b73765428fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.034780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc717d-8da4-44e1-bd4a-724557b52872 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.040079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.040757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.041069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.041353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.042217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.045756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.056614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1288/2600] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:32:58.057442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.061974 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.085784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1313/2601] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:58.086940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359830-d80a-4640-b294-b73765428fe9 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.088291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-67359830-d80a-4640-b294-b73765428fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.100909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67359830-d80a-4640-b294-b73765428fe9 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.105627 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.106507 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.106783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.107055 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] PATH_INFO: `/v3/projects/2048d6b6371b4e2998eebe13be1287de` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.108261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2048d6b6371b4e2998eebe13be1287de)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.110709 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.124779 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:58.126418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd2f2f-7b64-44e6-9143-54deec7fb40c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.130263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.130909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.132520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.132520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.141285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.142711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.152358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1289/2602] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:58.153145 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.162679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2bc86-129b-4935-ad3f-5dd7bb1cdf0f service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.167402 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.168233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.168516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.168791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] PATH_INFO: `/v3/projects/389c45f9f7ea4721b001f7268cd4aa57/users/2475b8af712540398018419e345a6992/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.171032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=389c45f9f7ea4721b001f7268cd4aa57, user_id=2475b8af712540398018419e345a6992, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.173724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.183937 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1290/2603] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:32:58 2022] PUT /identity/v3/projects/389c45f9f7ea4721b001f7268cd4aa57/users/2475b8af712540398018419e345a6992/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:58.193081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.193081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.238433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2048d6b6371b4e2998eebe13be1287de', 'request_id': 'req-24cdda41-a8c1-48e7-93f4-f0e647a88c49'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.250562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073391b-43ae-4046-baa8-0bc17cd8f497 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.298729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.299376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.299660 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.299985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.301513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2048d6b6371b4e2998eebe13be1287de', 'request_id': 'req-24cdda41-a8c1-48e7-93f4-f0e647a88c49'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.308340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2048d6b6371b4e2998eebe13be1287de', 'request_id': 'req-24cdda41-a8c1-48e7-93f4-f0e647a88c49'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.318920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] The token cache is being invalidate because project 2048d6b6371b4e2998eebe13be1287de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:58.319206 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.319972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-24cdda41-a8c1-48e7-93f4-f0e647a88c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.324607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1314/2604] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:58 2022] DELETE /identity/v3/projects/2048d6b6371b4e2998eebe13be1287de => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:58.324607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.324607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.324607 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.353576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] MFA Rules not processed for user `2475b8af712540398018419e345a6992`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:58.355050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.364901 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.368002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.380614 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1291/2605] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:58.381503 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.392032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:58.392188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854a3cf-4f45-455a-af5c-64d4e3d30743 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.397185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.400632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.400632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.400632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] PATH_INFO: `/v3/users/92b7641ad9c344ce93289731873fb265` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.400632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b7641ad9c344ce93289731873fb265)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.401959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.441250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1315/2606] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:58.458322 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.459792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.523407 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e944cfa-33f3-4e21-8253-c760c38eda3e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.527619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.528671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.528962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.529307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.541186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.542663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.554525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1316/2607] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:32:58.576584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b7641ad9c344ce93289731873fb265'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.634061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b7641ad9c344ce93289731873fb265'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.634965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b7641ad9c344ce93289731873fb265'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.651030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b7641ad9c344ce93289731873fb265'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.659222 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b7641ad9c344ce93289731873fb265'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:58.665786 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1292/2608] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:58 2022] DELETE /identity/v3/users/92b7641ad9c344ce93289731873fb265 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:58.670594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:58.704942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.714699 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4439dbc-378d-4531-bdad-9b2bdeb1990f service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:58.777819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:58.779057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:58.779371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:58.779653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:58.782467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:58.809932 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:58.844518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:58.845982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:58.855288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1317/2609] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:32:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:32:58.938066 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:58.939630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.023616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce2099-a4f0-427c-8d9f-340be245c8cd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.028442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.029235 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.029521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.029800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] PATH_INFO: `/v3/projects/4eb542c9c4974b58a918e62644f44796` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.031634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eb542c9c4974b58a918e62644f44796)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.033580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.152949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eb542c9c4974b58a918e62644f44796', 'request_id': 'req-e1314ed4-93f0-4ee6-99ee-e19535d94334'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.171920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.173565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.188109 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0787995f-87d9-444c-9c8f-d0eb02356a3b service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.233207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eb542c9c4974b58a918e62644f44796', 'request_id': 'req-e1314ed4-93f0-4ee6-99ee-e19535d94334'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.243105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eb542c9c4974b58a918e62644f44796', 'request_id': 'req-e1314ed4-93f0-4ee6-99ee-e19535d94334'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.257230 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.258013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] The token cache is being invalidate because project 4eb542c9c4974b58a918e62644f44796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:59.258321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.258444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.258851 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.259072 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.259339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] PATH_INFO: `/v3/projects/eace03e229bb4c36b327670e369ff74e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.264363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1293/2610] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:58 2022] DELETE /identity/v3/projects/4eb542c9c4974b58a918e62644f44796 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:59.273643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eace03e229bb4c36b327670e369ff74e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.274081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.274172 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.274275 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.278080 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1314ed4-93f0-4ee6-99ee-e19535d94334 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.284418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.285486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.285980 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.286183 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] PATH_INFO: `/v3/projects/bc1f3c59727c4cca8c92451826276009` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.287888 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1f3c59727c4cca8c92451826276009)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.292079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.300975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:59.387102 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eace03e229bb4c36b327670e369ff74e', 'request_id': 'req-f20495e9-37d4-41fc-9299-04bbcf8147b2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.450426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eace03e229bb4c36b327670e369ff74e', 'request_id': 'req-f20495e9-37d4-41fc-9299-04bbcf8147b2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.451491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1f3c59727c4cca8c92451826276009', 'request_id': 'req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.458444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eace03e229bb4c36b327670e369ff74e', 'request_id': 'req-f20495e9-37d4-41fc-9299-04bbcf8147b2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.471703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] The token cache is being invalidate because project eace03e229bb4c36b327670e369ff74e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:59.472141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.472820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-f20495e9-37d4-41fc-9299-04bbcf8147b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.474464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1318/2611] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:59 2022] DELETE /identity/v3/projects/eace03e229bb4c36b327670e369ff74e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:32:59.477906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.477906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.477906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.500615 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:59.502117 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.535900 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1f3c59727c4cca8c92451826276009', 'request_id': 'req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.543203 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1f3c59727c4cca8c92451826276009', 'request_id': 'req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.557930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] The token cache is being invalidate because project bc1f3c59727c4cca8c92451826276009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:32:59.558477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.566167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-3280338b-302c-48cf-a5f7-ae81c8f2d1d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.566167 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1294/2612] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:32:59 2022] DELETE /identity/v3/projects/bc1f3c59727c4cca8c92451826276009 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:59.567430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eb09c-d837-4cab-ad55-d3656fb258e6 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.567726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eb09c-d837-4cab-ad55-d3656fb258e6 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.568010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eb09c-d837-4cab-ad55-d3656fb258e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.570011 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1319/2613] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:59.577833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.579272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.586829 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dd9eb09c-d837-4cab-ad55-d3656fb258e6 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:59.591381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dd9eb09c-d837-4cab-ad55-d3656fb258e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.591528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241c71a-78ef-42ac-ac3e-683d0f767699 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.596753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1295/2614] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:59.596873 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.597655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.597941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.598050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026551-0e09-4e6e-bf68-b571884bee1d None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.598220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] PATH_INFO: `/v3/users/d8b6f0b1f0fe443c8f83ad53411d3b1e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.598306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026551-0e09-4e6e-bf68-b571884bee1d None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.598588 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1026551-0e09-4e6e-bf68-b571884bee1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.599439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8b6f0b1f0fe443c8f83ad53411d3b1e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.601388 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.618533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a1026551-0e09-4e6e-bf68-b571884bee1d None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:59.619729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a1026551-0e09-4e6e-bf68-b571884bee1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.627837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1296/2615] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:59.629082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.629368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.629642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.647352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:32:59.648519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.656911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1297/2616] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:32:59.660929 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.666881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f1598-7e14-414b-acad-cc756a7ddaf5 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.671476 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.672791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.672791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.672791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.673359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:59.673774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.675252 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.686881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1298/2617] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:59.690019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.697352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc02a103-c279-405e-8b2d-890c7b3176bd admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.702015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.703394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.703683 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.703961 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.704671 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:32:59.704982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.706558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.722458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1299/2618] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:32:59.722458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.730133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4321186-094d-4edf-8268-607615ca1d67 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.730882 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:32:59.734856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.735498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.735659 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8b6f0b1f0fe443c8f83ad53411d3b1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.735791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.736044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.736739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.738787 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.792514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8b6f0b1f0fe443c8f83ad53411d3b1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.805443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8b6f0b1f0fe443c8f83ad53411d3b1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.806251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8b6f0b1f0fe443c8f83ad53411d3b1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.812337 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1300/2619] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:59.814317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8b6f0b1f0fe443c8f83ad53411d3b1e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:32:59.816892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.818528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.820544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1320/2620] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:32:59 2022] DELETE /identity/v3/users/d8b6f0b1f0fe443c8f83ad53411d3b1e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:32:59.821331 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.824594 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:32:59.889497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab99b4-7e88-4129-93d7-e186714cc6d5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.897730 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.900188 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.903661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.903661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.903661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.903936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.906383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494da4f-b470-47e9-a691-b2e61f47388a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.911391 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:32:59.912057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:32:59.912335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:32:59.913111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:32:59.913463 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:32:59.915362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:32:59.971183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1321/2621] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/users => generated 287 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:59.975392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.977065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1301/2622] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:32:59.980110 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:32:59.988343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715b712-cb6a-451d-a843-40ee2e6498ce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:32:59.994968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:00.025618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:00.058096 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0cb4c2-1a3e-469a-a652-8d57314a1abc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.060043 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.060723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.061081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.062030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.062564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.063520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.064350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.064478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.065131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.065131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.066073 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.068075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.079484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1322/2623] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:00.080887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.092006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a3cab-bccc-4dab-9251-155fe55857e2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.096845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.097536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.097819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.098094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.098822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.100412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.111287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1323/2624] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:00.115279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.125508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc87de-55bf-455b-b6d5-e3809b63be23 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.130132 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.131001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.131285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.132120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] PATH_INFO: `/v3/projects/597fd531e2f24f9f9b7b050780d343a1/users/955eff878fec494ca303cf96521bc99b/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.147065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] RBAC: Authorizing `identity:create_grant(project_id=597fd531e2f24f9f9b7b050780d343a1, user_id=955eff878fec494ca303cf96521bc99b, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.149717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.237364 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1302/2625] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:32:59 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:00.241797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.252045 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90bc0-4793-4c6a-9d0f-d4bdf562dfac admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.256685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.257349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.257633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.257909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.258634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.260521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.273272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1303/2626] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:00.273548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1324/2627] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:00 2022] PUT /identity/v3/projects/597fd531e2f24f9f9b7b050780d343a1/users/955eff878fec494ca303cf96521bc99b/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:00.282510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.282674 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.284626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.295097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a22339a-9e41-42b4-82bc-9d43eca09d45 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.357428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e019e-4817-4a1a-9a3a-aa6fe3c350de admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.360264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.360987 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.361308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.361590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.362541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.364182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ceaec7-3963-4572-8e8b-7680049f927c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.365059 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.366110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.366547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.366972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] PATH_INFO: `/v3/projects/5907894bd9c14b86a410ed732ccb6b98` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.368333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5907894bd9c14b86a410ed732ccb6b98)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.372127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.375617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1304/2628] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:00.377070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.377359 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.377634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.409919 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] MFA Rules not processed for user `955eff878fec494ca303cf96521bc99b`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:00.411449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.480382 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5907894bd9c14b86a410ed732ccb6b98', 'request_id': 'req-ac39c95b-011f-4954-a060-052b1e2a60eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:00.480914 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1305/2629] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:00.481984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.495075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a71e0-7063-427d-a101-efe84ea6b479 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.508460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:00.537141 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5907894bd9c14b86a410ed732ccb6b98', 'request_id': 'req-ac39c95b-011f-4954-a060-052b1e2a60eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:00.547422 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5907894bd9c14b86a410ed732ccb6b98', 'request_id': 'req-ac39c95b-011f-4954-a060-052b1e2a60eb'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:00.549656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:00.560416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] The token cache is being invalidate because project 5907894bd9c14b86a410ed732ccb6b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:00.560758 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:00.562258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.562512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:00.563122 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.563707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.564316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] PATH_INFO: `/v3/projects/0f74dc1710a645b982d77786784f39fc/users/d54e4c21e7384cf6b971d1ad59d98dc3/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.565715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1325/2630] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:00 2022] DELETE /identity/v3/projects/5907894bd9c14b86a410ed732ccb6b98 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:00.571323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.573006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.586213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f74dc1710a645b982d77786784f39fc, user_id=d54e4c21e7384cf6b971d1ad59d98dc3, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.591255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc48827-a1c1-4c18-831b-b5147ea83eee admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.638387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39c95b-011f-4954-a060-052b1e2a60eb admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.642158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.642797 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.643076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.643351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.645156 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.667241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1306/2631] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:00 2022] PUT /identity/v3/projects/0f74dc1710a645b982d77786784f39fc/users/d54e4c21e7384cf6b971d1ad59d98dc3/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:00.667241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c077855-ab10-437b-b7b2-88aabf7870b5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.667241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c077855-ab10-437b-b7b2-88aabf7870b5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.667241 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c077855-ab10-437b-b7b2-88aabf7870b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.685319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5c077855-ab10-437b-b7b2-88aabf7870b5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:00.686560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5c077855-ab10-437b-b7b2-88aabf7870b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.707810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.709280 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7545ed-ffdd-47f0-997c-49c077ff1d6b service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.719262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1326/2632] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:00.721224 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.721718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.721996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.750767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1307/2633] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:00.751733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] MFA Rules not processed for user `d54e4c21e7384cf6b971d1ad59d98dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:00.752950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.758752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.759398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.759967 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.782879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:00.784108 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.793468 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1308/2634] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:00.798491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.808495 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701bb4f-d8a3-4054-b3ef-274328a55889 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.814253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.814855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.815141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.815419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.816296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:00.816610 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.818246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.836440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1309/2635] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:00.838059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.841488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1327/2636] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:00.845447 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.850288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:00.852248 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674246c-ca2d-4e67-a802-08c160b5b3ae admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.857138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.857790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.858209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.859353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.860253 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.862508 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.868384 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd83a0dc-28ca-4867-94b2-fac8600fdcad None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:00.874297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:00.875057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:00.875345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:00.875786 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:00.876470 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:00.878807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:00.943154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1310/2637] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:00.947166 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.963338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1328/2638] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:00.968805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:00.990168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:01.041002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:01.045276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a208019-3046-424a-9245-6eb73f694098 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.067624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb307e-3cd6-4716-9508-da875a592297 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.073151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.075248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.075248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.075248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.075248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.077935 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.115074 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.115775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.116058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.116333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.117041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.119010 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.158748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1329/2639] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:01.162644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.172716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bce7da-282d-4669-9366-8a0687a718c9 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.177312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.177939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.178222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.178489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.179203 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.180748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.191126 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1330/2640] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:01.195037 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.204923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5d83dd-bdaf-4268-8129-fa4098316e2f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.209682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.210624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.213077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.213077 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] PATH_INFO: `/v3/projects/b8ecb64a278f44c2b1e7cc777533b726/users/b3cbb2fb0eac46fdabaa4775eb7c3b42/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.226444 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ecb64a278f44c2b1e7cc777533b726, user_id=b3cbb2fb0eac46fdabaa4775eb7c3b42, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.229140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.239783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1311/2641] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:00 2022] POST /identity/v3/users => generated 284 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:01.243766 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.254285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07638a2-75a4-4e31-82b1-2a68bd1d2fed admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.259023 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.259760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.260075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.260353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.261118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.262726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.273326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1312/2642] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:01.277303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.287587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9685b5-b0c1-4b19-b098-d24499c64d23 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.292197 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.292828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.293273 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.293556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.294274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.296415 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.306681 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1313/2643] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:01.310647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.320461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1331/2644] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:01 2022] PUT /identity/v3/projects/b8ecb64a278f44c2b1e7cc777533b726/users/b3cbb2fb0eac46fdabaa4775eb7c3b42/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:01.321856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2adff7f-ca46-47c7-820b-64e96ad78e89 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.324008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.380827 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.381755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.382037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.382312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] PATH_INFO: `/v3/projects/15b14ed5237f46f3904e8ae4f7358446/users/ec4f3f98a9f740109e96c0c6238d9d7e/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.391142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a346e-38e6-4a67-9e31-0af37bc943de admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.396049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.396741 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.397047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.397163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15b14ed5237f46f3904e8ae4f7358446, user_id=ec4f3f98a9f740109e96c0c6238d9d7e, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.397345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.398095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.399654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.399770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5497db-a19a-4b3f-9bf4-aeda86064062 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.410237 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1332/2645] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:01.414628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.424426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7ad1f-8a85-4b70-b08b-bb9555bc2ef0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.429042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.429901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.430185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.430462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] PATH_INFO: `/v3/projects/b8ecb64a278f44c2b1e7cc777533b726/users/b3cbb2fb0eac46fdabaa4775eb7c3b42/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.432423 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ecb64a278f44c2b1e7cc777533b726, user_id=b3cbb2fb0eac46fdabaa4775eb7c3b42, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.435239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d85330-64a0-4fe0-838e-921775ba03c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.446101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1333/2646] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:01 2022] PUT /identity/v3/projects/b8ecb64a278f44c2b1e7cc777533b726/users/b3cbb2fb0eac46fdabaa4775eb7c3b42/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:01.456916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.458889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.458889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.489503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] MFA Rules not processed for user `b3cbb2fb0eac46fdabaa4775eb7c3b42`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:01.493283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:01.493389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1314/2647] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:01 2022] PUT /identity/v3/projects/15b14ed5237f46f3904e8ae4f7358446/users/ec4f3f98a9f740109e96c0c6238d9d7e/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:01.503566 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.503860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.504138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.532554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] MFA Rules not processed for user `ec4f3f98a9f740109e96c0c6238d9d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:01.533796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:01.567733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1334/2648] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:01.579652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.603612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1315/2649] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:01.606006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.639941 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59e737-14fc-4233-a2a6-f1b4a890db69 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.646261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.646993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.647275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.647554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.673042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8137cb-df71-4afb-91db-a6dc66f50080 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.678539 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.679251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.679538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.681126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.681126 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.682451 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.701529 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:01.704874 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.709914 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.715304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1335/2650] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:33:01.760021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:01.767131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1316/2651] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:01 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:01.771348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.783092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7044eb6-7e2b-452b-a591-4649ea113219 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.838110 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.838806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.839340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.839625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.840323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.842309 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.936030 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1336/2652] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:01 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:01.945803 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:01.963037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e9959b-3f59-4ac2-8e72-0b7053c07c21 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:01.969578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:01.970946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:01.971477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:01.971939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:01.973331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:01.977710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:01.996353 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1317/2653] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:02.001525 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:02.012021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d5f601-2c31-4fc8-bf2d-9c602f09e1dd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:02.019032 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:02.019878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.020164 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.020441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] PATH_INFO: `/v3/projects/29657ed0d3454090863e27cf038f9212/users/5f991978d2fd4e3d962a49788f07bfc7/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.038712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=29657ed0d3454090863e27cf038f9212, user_id=5f991978d2fd4e3d962a49788f07bfc7, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:02.041521 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:02.161459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1337/2654] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:02 2022] PUT /identity/v3/projects/29657ed0d3454090863e27cf038f9212/users/5f991978d2fd4e3d962a49788f07bfc7/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:02.162969 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:02.174520 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5b38b-d291-41b1-8d5e-76a119b088b6 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:02.181954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:02.247741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:02.248423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.248735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.249668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.250418 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:02.252039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae0b9e-419e-402a-8bbc-1fa89167eba7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:02.262118 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1318/2655] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:02.267067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:02.277479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a0f68-0d9b-42ba-86fc-e4fb71f98b2c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:02.282201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:02.283083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.283371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.283653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] PATH_INFO: `/v3/projects/29657ed0d3454090863e27cf038f9212/users/5f991978d2fd4e3d962a49788f07bfc7/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.285697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29657ed0d3454090863e27cf038f9212, user_id=5f991978d2fd4e3d962a49788f07bfc7, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:02.288334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:02.299675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1338/2656] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:02 2022] PUT /identity/v3/projects/29657ed0d3454090863e27cf038f9212/users/5f991978d2fd4e3d962a49788f07bfc7/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:02.366138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.366358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.366644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.395035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] MFA Rules not processed for user `5f991978d2fd4e3d962a49788f07bfc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:02.396251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:02.453417 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:02.482741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1319/2657] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:02.490467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:02.549445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac839c5-cdc0-4a39-85ef-abbd46da8d6e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:02.553968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:02.554633 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.554906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.555186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.565698 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:02.567166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:02.578262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1339/2658] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:02 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:02.852232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:02.869202 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8ff44-2d80-4985-a4c9-523788679d93 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:02.871711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:02.872376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:02.872657 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:02.872930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:02.932242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:02.933723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:02.943426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1320/2659] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:05.191234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:05.192820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:05.204682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8db9a2-c795-4421-85ff-bfe23cff8090 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:05.208400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:05.209151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:05.209443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:05.209804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:05.279355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:05.281779 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f44247-de80-42ec-85a8-591f6808d0cc service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:05.292451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1340/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:08.431448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:08.434327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:08.512262 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84210ca6-32b1-4866-97ac-6c9a97d1f03c service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:08.517329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:08.518213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:08.518498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:08.518775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] PATH_INFO: `/v3/users/c06ac32542dc4baebf5fb94906a7148b` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:08.519985 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06ac32542dc4baebf5fb94906a7148b)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:08.521953 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:08.696661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06ac32542dc4baebf5fb94906a7148b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:08.775478 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06ac32542dc4baebf5fb94906a7148b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:08.776094 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06ac32542dc4baebf5fb94906a7148b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:08.789580 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06ac32542dc4baebf5fb94906a7148b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:08.796740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06ac32542dc4baebf5fb94906a7148b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:08.798312 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:08.803752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1321/2661] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:08 2022] DELETE /identity/v3/users/c06ac32542dc4baebf5fb94906a7148b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:08.808271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:08.808747 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:08.808835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:08.829591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:08.831111 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:08.908468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1341/2662] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:08.918341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:08.919793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:08.979986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f44b6a-0add-4318-b966-5dcddaaf7cf3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:08.983880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:08.984554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:08.984847 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:08.985173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:08.994429 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:08.995870 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:09.006217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1322/2663] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:09.459592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:09.461220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:09.476994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb9ff9-3381-4a63-a065-0db7e3fee5c8 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:09.481799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:09.482670 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:09.482995 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:09.483755 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] PATH_INFO: `/v3/projects/c7de2d1910bf4474ba7d9f3dab1cd081` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:09.484976 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7de2d1910bf4474ba7d9f3dab1cd081)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:09.487962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:09.505545 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:09.611857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7de2d1910bf4474ba7d9f3dab1cd081', 'request_id': 'req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:09.654660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7de2d1910bf4474ba7d9f3dab1cd081', 'request_id': 'req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:09.661950 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7de2d1910bf4474ba7d9f3dab1cd081', 'request_id': 'req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:09.672792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] The token cache is being invalidate because project c7de2d1910bf4474ba7d9f3dab1cd081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:09.673201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:09.673822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:09.675339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1342/2664] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:09 2022] DELETE /identity/v3/projects/c7de2d1910bf4474ba7d9f3dab1cd081 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:09.679502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:09.690091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0123731-1e56-4bca-af95-f3a7d8360171 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:09.750044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:09.750990 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:09.751268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:09.751546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] PATH_INFO: `/v3/users/2475b8af712540398018419e345a6992` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:09.752742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2475b8af712540398018419e345a6992)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:09.754863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:09.970148 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2475b8af712540398018419e345a6992'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.009819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2475b8af712540398018419e345a6992'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.010327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2475b8af712540398018419e345a6992'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.024194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2475b8af712540398018419e345a6992'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.032365 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2475b8af712540398018419e345a6992'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.038423 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1323/2665] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:09 2022] DELETE /identity/v3/users/2475b8af712540398018419e345a6992 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:10.173259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.174656 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.187471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09bde9a-1c7c-4a4c-a5f7-8982bdf0088e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:10.246582 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:10.247462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.247739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.248019 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] PATH_INFO: `/v3/users/ec4f3f98a9f740109e96c0c6238d9d7e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.249227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4f3f98a9f740109e96c0c6238d9d7e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:10.251931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:10.446399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4f3f98a9f740109e96c0c6238d9d7e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.474042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.475544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.499800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20807c51-b337-4bb4-9b23-5ad5d58d85b8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:10.504136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:10.505006 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.505335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.505617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] PATH_INFO: `/v3/projects/389c45f9f7ea4721b001f7268cd4aa57` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.506895 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=389c45f9f7ea4721b001f7268cd4aa57)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:10.508801 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:10.526956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:10.540852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4f3f98a9f740109e96c0c6238d9d7e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.557051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4f3f98a9f740109e96c0c6238d9d7e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.558114 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4f3f98a9f740109e96c0c6238d9d7e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.574459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-becff78c-cd9c-4729-9142-6281eec0a3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4f3f98a9f740109e96c0c6238d9d7e'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.585312 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1343/2666] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:10 2022] DELETE /identity/v3/users/ec4f3f98a9f740109e96c0c6238d9d7e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:10.592556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.592879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.593184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.612512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:10.613769 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.626298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '389c45f9f7ea4721b001f7268cd4aa57', 'request_id': 'req-7842c035-4ce6-4ac1-8b69-4b4600b75498'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.633339 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:10.675544 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1344/2667] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:10.683963 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '389c45f9f7ea4721b001f7268cd4aa57', 'request_id': 'req-7842c035-4ce6-4ac1-8b69-4b4600b75498'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.685184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.686745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.692538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '389c45f9f7ea4721b001f7268cd4aa57', 'request_id': 'req-7842c035-4ce6-4ac1-8b69-4b4600b75498'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.705630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] The token cache is being invalidate because project 389c45f9f7ea4721b001f7268cd4aa57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:10.706014 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.706751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7842c035-4ce6-4ac1-8b69-4b4600b75498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:10.708394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1324/2668] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:10 2022] DELETE /identity/v3/projects/389c45f9f7ea4721b001f7268cd4aa57 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:10.717326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba51e-e428-45b4-b3af-c34fe5b62355 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.717687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba51e-e428-45b4-b3af-c34fe5b62355 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.718042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba51e-e428-45b4-b3af-c34fe5b62355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.736875 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-26fba51e-e428-45b4-b3af-c34fe5b62355 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:10.738208 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-26fba51e-e428-45b4-b3af-c34fe5b62355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.746656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1325/2669] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:10.754936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.755159 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d9e37-90b7-4bc4-8354-4247e461c974 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:10.755280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.755596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.759108 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:10.759993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.760316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.760599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.762892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.773673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:10.774855 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:10.776374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:10.777906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:10.782845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1326/2670] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:10.787414 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.788084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1345/2671] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:10.796578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54e81-959b-4c86-97dc-377b1ae1aaa2 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:10.802070 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:10.802874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.803156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.803578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.804182 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:10.804488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:10.806191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:10.822725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1327/2672] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:10.823764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.834303 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24504e18-562d-4109-bf20-bae64b7f1ad8 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:10.839061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:10.840227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:10.840227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:10.840534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:10.841263 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:10.843200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:10.931414 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1346/2673] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:10 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:10.935396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:10.946059 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc34f01e-ee91-4c95-b336-70aef6712a9a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.012528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.013321 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.013692 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.014034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.014777 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.016869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.076609 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1328/2674] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:10 2022] POST /identity/v3/users => generated 278 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:11.077900 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.089945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be54902-9472-48e0-9bf6-d7fa67e69ad5 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.095211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.095984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.096369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.096715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.097562 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.099162 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.110413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1347/2675] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:11.114398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.124381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93e5a0-9f76-431e-b9e1-5735d0b18808 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.129782 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.130444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.130770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.132533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.132533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.133525 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.144288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1329/2676] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:11.148605 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.159541 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86975c02-cf2a-48f8-bcf7-6dc221c4a9d4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.164547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.165455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.165742 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.166021 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] PATH_INFO: `/v3/projects/6412482294f84894810235116b04b5ba/users/e51e099fde464b82944925a58c80d7a8/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.184369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6412482294f84894810235116b04b5ba, user_id=e51e099fde464b82944925a58c80d7a8, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.184945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.185180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:11.185293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f31ec-c02b-4794-bcb3-345695d5ba10 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.200567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba637c0-19df-4ffb-964e-c32787c35aa8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.206433 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.212806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.212806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.212806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] PATH_INFO: `/v3/projects/15b14ed5237f46f3904e8ae4f7358446` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.212806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15b14ed5237f46f3904e8ae4f7358446)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.212806 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.256196 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1348/2677] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:11 2022] PUT /identity/v3/projects/6412482294f84894810235116b04b5ba/users/e51e099fde464b82944925a58c80d7a8/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:11.268031 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.268316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.268617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.293993 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] MFA Rules not processed for user `e51e099fde464b82944925a58c80d7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:11.295186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:11.348162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15b14ed5237f46f3904e8ae4f7358446', 'request_id': 'req-0eeebf95-0b2b-4e58-a43e-ad65322ca878'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.350190 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:11.355020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:11.360876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1349/2678] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:11 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:11.365228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.428461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56877f4-ed1d-4e29-bfcb-96bd6b0f9e8e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.483971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15b14ed5237f46f3904e8ae4f7358446', 'request_id': 'req-0eeebf95-0b2b-4e58-a43e-ad65322ca878'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.484175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.485190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.485471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.485829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.486517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.488445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.490488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15b14ed5237f46f3904e8ae4f7358446', 'request_id': 'req-0eeebf95-0b2b-4e58-a43e-ad65322ca878'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.502755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] The token cache is being invalidate because project 15b14ed5237f46f3904e8ae4f7358446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:11.503044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.503729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.505420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1330/2679] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:11 2022] DELETE /identity/v3/projects/15b14ed5237f46f3904e8ae4f7358446 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:11.509146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.510422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:11.522856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeebf95-0b2b-4e58-a43e-ad65322ca878 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.527425 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.528285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.528567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.528843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] PATH_INFO: `/v3/users/5f991978d2fd4e3d962a49788f07bfc7` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.530061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f991978d2fd4e3d962a49788f07bfc7)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.532002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.582804 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1350/2680] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:11 2022] POST /identity/v3/projects => generated 357 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:11.586883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.588502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:11.652184 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681bb16b-470f-41e5-8a4e-9cae627db2fd admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.658867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.659542 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.659828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.660106 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.660799 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.662974 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.759937 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1351/2681] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:11 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:11.764358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.767538 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f991978d2fd4e3d962a49788f07bfc7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.774978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded6578-e609-4cef-a04e-350dbb0b8852 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.779801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.780626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.780960 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.784027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.784027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.784798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.794877 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1352/2682] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:11.799489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.809262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b83bee-67ca-464e-9b99-825f47788470 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:11.814185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:11.815034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:11.815318 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:11.815591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] PATH_INFO: `/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41/users/113cdbcca91e4d3486789972fde643e3/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:11.818878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:11.830634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c6b1a36d384d0ca7de5c2718cbae41, user_id=113cdbcca91e4d3486789972fde643e3, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:11.833342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:11.849695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f991978d2fd4e3d962a49788f07bfc7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.850320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f991978d2fd4e3d962a49788f07bfc7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.866922 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f991978d2fd4e3d962a49788f07bfc7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.876026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f991978d2fd4e3d962a49788f07bfc7'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:11.880528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1331/2683] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:11 2022] DELETE /identity/v3/users/5f991978d2fd4e3d962a49788f07bfc7 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:11.954124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1353/2684] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:11 2022] PUT /identity/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41/users/113cdbcca91e4d3486789972fde643e3/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:11.958035 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:11.959723 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.029448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d450cc-809c-47b2-af26-cd5172a5143f admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.091019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:12.100106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.100797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.101109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.101388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.102131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.103934 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2df13-b249-48e7-87c4-92ffd0c3fd83 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.115229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1332/2685] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:12.119380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.130065 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb798-9f5e-4048-afc0-ffaf7d302450 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.135098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.135981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.136300 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.136616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] PATH_INFO: `/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41/users/113cdbcca91e4d3486789972fde643e3/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.138610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7c6b1a36d384d0ca7de5c2718cbae41, user_id=113cdbcca91e4d3486789972fde643e3, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.146058 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.153363 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1354/2686] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:12 2022] PUT /identity/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41/users/113cdbcca91e4d3486789972fde643e3/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:12.163368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.164039 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.164565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.196067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] MFA Rules not processed for user `113cdbcca91e4d3486789972fde643e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:12.197370 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.282808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1333/2687] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:12.291323 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.293324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.298943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.298943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.359061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b22c4-351c-43c0-9ee9-182b28dbdad1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.363563 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.364210 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.364491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.364768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.374043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.375936 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.379168 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7912cb8-6e1d-49d7-af9b-1dc02a603414 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.383909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.384772 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.385142 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.385452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] PATH_INFO: `/v3/projects/29657ed0d3454090863e27cf038f9212` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.385840 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1334/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:33:12.386712 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29657ed0d3454090863e27cf038f9212)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.388702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.502871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29657ed0d3454090863e27cf038f9212', 'request_id': 'req-ea0c2911-4b56-4cd1-94a1-5f2b98897351'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:12.586825 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29657ed0d3454090863e27cf038f9212', 'request_id': 'req-ea0c2911-4b56-4cd1-94a1-5f2b98897351'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:12.593812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29657ed0d3454090863e27cf038f9212', 'request_id': 'req-ea0c2911-4b56-4cd1-94a1-5f2b98897351'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:12.605345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] The token cache is being invalidate because project 29657ed0d3454090863e27cf038f9212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:12.605717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:12.606390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-ea0c2911-4b56-4cd1-94a1-5f2b98897351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:12.606755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.608099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1355/2689] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:12 2022] DELETE /identity/v3/projects/29657ed0d3454090863e27cf038f9212 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:12.613638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d17-0ae2-4fa0-86ed-879cf635649a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.619355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d17-0ae2-4fa0-86ed-879cf635649a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.619355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d117d17-0ae2-4fa0-86ed-879cf635649a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.619542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3953b-436b-46b7-98b5-cd98ab3920e3 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.632506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-7d117d17-0ae2-4fa0-86ed-879cf635649a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:12.633727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-7d117d17-0ae2-4fa0-86ed-879cf635649a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.666746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.667400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.667678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.667973 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.669854 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.696079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1356/2690] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:12.703985 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.704738 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.705049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.709144 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=100 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:12.712662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:12.727342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:12.728568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.736277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.737190 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1357/2691] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:12.737835 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.741081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.745625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:12.747193 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1335/2692] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:12 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:33:12.747931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.753954 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba3d26-c582-437e-9d34-2ef7201e64ad None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.759040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.759308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43aef7-ac04-4e0d-a6ba-1e02634aafae service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.760124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.760406 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.760680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] PATH_INFO: `/v3/users/955eff878fec494ca303cf96521bc99b` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.762089 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=955eff878fec494ca303cf96521bc99b)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.764205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.764740 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.766173 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.768757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.768757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.768757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:12.768757 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.770133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.783739 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1336/2693] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:12.788099 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.798673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7482b-6d1f-4e60-bd26-2316c4ec677e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.803336 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.805466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.805466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.805466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.805466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.807125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.894546 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1337/2694] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:12 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:12.895534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:12.958030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0b268-5084-4d73-9941-712c81145375 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:12.962878 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:12.963557 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:12.963843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:12.964124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:12.965101 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:12.967032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:12.991239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '955eff878fec494ca303cf96521bc99b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.077931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '955eff878fec494ca303cf96521bc99b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.088223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1338/2695] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:12 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:13.089572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.095453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '955eff878fec494ca303cf96521bc99b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.096143 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '955eff878fec494ca303cf96521bc99b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.100366 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae4b20-5be2-4d36-ac55-74244d1f0715 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.103099 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-0a5ec34e-8a56-482d-8269-7f34b700e425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '955eff878fec494ca303cf96521bc99b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.105270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.105931 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.106216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.106497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.107261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.108843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.109195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1358/2696] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:12 2022] DELETE /identity/v3/users/955eff878fec494ca303cf96521bc99b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:13.113979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.114269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.114547 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.120821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1339/2697] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:13.124696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.127019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:13.133630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:13.134845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:13.139594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec007c24-f19b-48db-9b5a-f556642546b2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.196785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1359/2698] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:13.206389 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.207847 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:13.215643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.216440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.216819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.217196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.217996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.220555 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.233062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1340/2699] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:13.236586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.248497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31eb1b-6678-424a-801c-724668d04a3e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.256002 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.257394 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.257677 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.257954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] PATH_INFO: `/v3/projects/28ff3fec442a4de486b65b19bcc1d4eb/users/cfa09bb48d4c4d8cb35b1a8bc5b6702f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.270820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:13.273774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ff3fec442a4de486b65b19bcc1d4eb, user_id=cfa09bb48d4c4d8cb35b1a8bc5b6702f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.276455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.283617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3588f61-54b5-43b5-96c7-498a729fae0f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.289512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.289512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.289512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.289512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.299657 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.301236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f6a24-39cb-4e70-a570-dd115abc6a5c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.310943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1360/2700] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:13.323819 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1341/2701] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:13 2022] PUT /identity/v3/projects/28ff3fec442a4de486b65b19bcc1d4eb/users/cfa09bb48d4c4d8cb35b1a8bc5b6702f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:13.329812 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.330100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.330373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.349299 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:13.350716 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:13.356064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:13.418387 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1361/2702] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:13.429114 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.486302 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7df18-5631-43c6-9123-09709f25511e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.490267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.490924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.491212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.491502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.501483 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.502998 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcaabfb-b882-4aba-b5b3-b7387fcacbaf service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.513711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1342/2703] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:13.720988 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:13.722673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:13.735166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9587b-f4b8-4430-8bf1-cd848d6ac588 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:13.740010 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:13.740891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:13.741207 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:13.741487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] PATH_INFO: `/v3/projects/597fd531e2f24f9f9b7b050780d343a1` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:13.742840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597fd531e2f24f9f9b7b050780d343a1)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:13.744766 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:13.877723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597fd531e2f24f9f9b7b050780d343a1', 'request_id': 'req-578ab934-eb5a-4468-9f78-5e1a4c9f7095'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.946920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597fd531e2f24f9f9b7b050780d343a1', 'request_id': 'req-578ab934-eb5a-4468-9f78-5e1a4c9f7095'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.965637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597fd531e2f24f9f9b7b050780d343a1', 'request_id': 'req-578ab934-eb5a-4468-9f78-5e1a4c9f7095'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.979430 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] The token cache is being invalidate because project 597fd531e2f24f9f9b7b050780d343a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:13.979894 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.980572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:13.982181 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1362/2704] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:13 2022] DELETE /identity/v3/projects/597fd531e2f24f9f9b7b050780d343a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:19.325226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:19.325761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:19.325918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:19.355385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] MFA Rules not processed for user `cfa09bb48d4c4d8cb35b1a8bc5b6702f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:19.356685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:19.422187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1343/2705] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:19.426844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:19.428223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:19.495439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ab934-eb5a-4468-9f78-5e1a4c9f7095 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:19.500256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:19.501085 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:19.501377 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:19.501658 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:19.502362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:19.504257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:19.622736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1363/2706] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:19 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:19.626984 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:19.637796 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a2a4f-e78c-4a11-abe1-2899498aa6f1 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:19.696988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:19.697727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:19.698042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:19.698323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:19.699041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:19.700962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:19.833668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1344/2707] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:19 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:19.837578 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:19.848177 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad099bc7-f2df-4ccd-9d74-56064c843181 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:19.852845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:19.855455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:19.855455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:19.855455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:19.855455 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:19.856451 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:19.868486 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1364/2708] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:19.872797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:19.884502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eac8e-eb70-454c-a1a7-fbce1314340e admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:19.889769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:19.890242 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:19.890558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:19.890957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] PATH_INFO: `/v3/projects/ab8c697589664085b5d48d805b2d43dd/users/2962989bb4444fcb8b262db59dca2775/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:19.908773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:19.916868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8c697589664085b5d48d805b2d43dd, user_id=2962989bb4444fcb8b262db59dca2775, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:19.919866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:20.049233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1345/2709] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:19 2022] PUT /identity/v3/projects/ab8c697589664085b5d48d805b2d43dd/users/2962989bb4444fcb8b262db59dca2775/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:20.050476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:20.061097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0166bf6-319e-4c62-a3c6-1224bfd273ea admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:20.066609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:20.120146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:20.120844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:20.121158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:20.121434 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:20.122154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:20.123736 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:20.137355 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1365/2710] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:20.138445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:20.149859 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724b1ee-cf12-4e43-a2c4-a235eb0b5b75 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:20.154498 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:20.155435 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:20.160876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:20.160876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] PATH_INFO: `/v3/projects/ab8c697589664085b5d48d805b2d43dd/users/2962989bb4444fcb8b262db59dca2775/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:20.160876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8c697589664085b5d48d805b2d43dd, user_id=2962989bb4444fcb8b262db59dca2775, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:20.160876 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ed535-d0ff-4365-a283-d380395700a3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:20.172034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1346/2711] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:20 2022] PUT /identity/v3/projects/ab8c697589664085b5d48d805b2d43dd/users/2962989bb4444fcb8b262db59dca2775/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:20.825383 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:20.829287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:20.848990 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d9cdb-e5b7-4965-a223-8e710b14ab1c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:20.925187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:20.925187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:20.925187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:20.925187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] PATH_INFO: `/v3/users/d54e4c21e7384cf6b971d1ad59d98dc3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:20.930101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54e4c21e7384cf6b971d1ad59d98dc3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:20.932746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:21.149890 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54e4c21e7384cf6b971d1ad59d98dc3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:21.226685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54e4c21e7384cf6b971d1ad59d98dc3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:21.245449 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54e4c21e7384cf6b971d1ad59d98dc3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:21.245893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54e4c21e7384cf6b971d1ad59d98dc3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:21.261850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54e4c21e7384cf6b971d1ad59d98dc3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:21.271512 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1366/2712] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:20 2022] DELETE /identity/v3/users/d54e4c21e7384cf6b971d1ad59d98dc3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:21.276079 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:21.276630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:21.276630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:21.298993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:21.300992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:21.380997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1347/2713] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:21.400033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:21.400033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:21.432245 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:21.463372 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75c127-7822-43b5-bec8-b6c7aede2d34 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:21.467475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:21.468135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:21.468432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:21.468864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:21.480572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:21.482729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:21.496989 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1367/2714] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:22.173935 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:22.175807 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:22.192454 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd004044-0418-46ce-ae79-7453b2f64b61 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:22.205378 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:22.206654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:22.207161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:22.207613 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] PATH_INFO: `/v3/projects/0f74dc1710a645b982d77786784f39fc` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:22.209215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f74dc1710a645b982d77786784f39fc)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:22.211877 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:22.356243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f74dc1710a645b982d77786784f39fc', 'request_id': 'req-6f3423b2-640b-4d98-9ab8-6a00298288c3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.452112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f74dc1710a645b982d77786784f39fc', 'request_id': 'req-6f3423b2-640b-4d98-9ab8-6a00298288c3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.459517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f74dc1710a645b982d77786784f39fc', 'request_id': 'req-6f3423b2-640b-4d98-9ab8-6a00298288c3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.474363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] The token cache is being invalidate because project 0f74dc1710a645b982d77786784f39fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:22.474913 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.475780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.478368 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1348/2715] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:22 2022] DELETE /identity/v3/projects/0f74dc1710a645b982d77786784f39fc => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:22.482091 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:22.497440 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c62b4-11bc-4281-a4d7-f73803477511 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:22.610424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:22.611533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:22.611879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:22.612366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] PATH_INFO: `/v3/users/b3cbb2fb0eac46fdabaa4775eb7c3b42` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:22.613854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3cbb2fb0eac46fdabaa4775eb7c3b42)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:22.616701 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:22.822498 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3cbb2fb0eac46fdabaa4775eb7c3b42'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.930364 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3cbb2fb0eac46fdabaa4775eb7c3b42'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.973880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3cbb2fb0eac46fdabaa4775eb7c3b42'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.975485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3cbb2fb0eac46fdabaa4775eb7c3b42'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.985259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-55a69fb8-1eff-45d0-8f34-a67e4931c608 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3cbb2fb0eac46fdabaa4775eb7c3b42'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:22.992883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1368/2716] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:22 2022] DELETE /identity/v3/users/b3cbb2fb0eac46fdabaa4775eb7c3b42 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:23.542705 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:23.544599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:23.576752 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3423b2-640b-4d98-9ab8-6a00298288c3 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:23.646466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:23.647341 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:23.647632 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:23.647975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] PATH_INFO: `/v3/projects/b8ecb64a278f44c2b1e7cc777533b726` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:23.649219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ecb64a278f44c2b1e7cc777533b726)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:23.651159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:23.652825 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:23.788765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ecb64a278f44c2b1e7cc777533b726', 'request_id': 'req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:23.860785 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ecb64a278f44c2b1e7cc777533b726', 'request_id': 'req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:23.867612 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ecb64a278f44c2b1e7cc777533b726', 'request_id': 'req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:23.882572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] The token cache is being invalidate because project b8ecb64a278f44c2b1e7cc777533b726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:23.883157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:23.884008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-f78cd7bf-ae80-4b22-8bc3-a5e6eb8230f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:23.886065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1349/2717] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:23 2022] DELETE /identity/v3/projects/b8ecb64a278f44c2b1e7cc777533b726 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:23.891827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:23.893345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:23.893840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:23.916229 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:23.917514 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:24.009404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:24.037433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1369/2718] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:24.043584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.049725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.049725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.068280 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:24.070093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:24.088069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1350/2719] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:24.092837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.103998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f809a2e-23ac-4776-9313-a2cbe19698f3 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.110028 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.110745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.111201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.111477 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.112240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:24.112548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.114201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.136596 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1370/2720] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:24.139320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.150633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6cbc5-3327-4704-8669-fea687285fed None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.156184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.157755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.158207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.158751 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.159605 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.164181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.314376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1351/2721] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:24 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:24.316929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.332572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553f4c24-cdfd-428a-b3bd-a653d1bf2a5b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.417239 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.426917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.427535 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.427971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.439717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.439717 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.520801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1371/2722] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:24 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:24.525261 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.536194 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8fb15-df3e-40fc-aa39-2b10a0bd0545 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.553291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.555238 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.557518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.557958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.559058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.564954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.596562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1352/2723] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:24.600271 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.618774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df66e72-58c0-42fc-83dd-fe9ad0f75687 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.627869 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.628569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.628854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.629171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.629918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.631527 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381549e4-51f0-4225-8c86-39bc501d0866 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.644035 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1372/2724] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:24.652019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.660104 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075ad00-0917-456f-9f33-981c594515f4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:24.669042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:24.670135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.670962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.671405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] PATH_INFO: `/v3/projects/b6677214743944e1864147b4fd07e551/users/8458e4e818b74d0a9e1fb2b36ad99a97/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.695199 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6677214743944e1864147b4fd07e551, user_id=8458e4e818b74d0a9e1fb2b36ad99a97, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:24.699630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:24.755216 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1353/2725] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:24 2022] PUT /identity/v3/projects/b6677214743944e1864147b4fd07e551/users/8458e4e818b74d0a9e1fb2b36ad99a97/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:24.768137 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3f21-b44a-44a0-91ea-0a2460cc19ee None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:24.768341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3f21-b44a-44a0-91ea-0a2460cc19ee None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:24.768679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3f21-b44a-44a0-91ea-0a2460cc19ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:24.824737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-667f3f21-b44a-44a0-91ea-0a2460cc19ee None None] MFA Rules not processed for user `8458e4e818b74d0a9e1fb2b36ad99a97`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:24.826443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-667f3f21-b44a-44a0-91ea-0a2460cc19ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:24.919679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1373/2726] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:24.934992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:24.936886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:25.006593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68526ab-de67-446e-97c9-f56f402902aa admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:25.013472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:25.013472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:25.013673 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:25.013838 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:25.026771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:25.028995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:25.042328 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1354/2727] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:26.476675 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:26.477571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:26.478084 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:26.527135 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] MFA Rules not processed for user `2962989bb4444fcb8b262db59dca2775`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:26.529324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:26.573232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:26.617251 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1374/2728] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:26.633458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:26.634932 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:26.689464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:26.736091 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29c7cab-156e-49fb-af16-86608e1a16a9 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:26.741780 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:26.742481 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:26.742771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:26.743053 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:26.745012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:26.818443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:26.820279 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef229f-9d9e-4c65-b993-998b42075437 service nova] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:26.830254 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1355/2729] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:29.210651 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:29.329248 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75adb0d-26f0-4b00-bab7-dc68c042ae97 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:29.334349 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:29.335243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:29.335564 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:29.335835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] PATH_INFO: `/v3/users/8458e4e818b74d0a9e1fb2b36ad99a97` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:29.337145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8458e4e818b74d0a9e1fb2b36ad99a97)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:29.339107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:29.457298 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f6785-560a-4a3c-8156-26bdc2fc78fc None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:29.457747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f6785-560a-4a3c-8156-26bdc2fc78fc None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:29.457846 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f6785-560a-4a3c-8156-26bdc2fc78fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:29.476291 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dc9f6785-560a-4a3c-8156-26bdc2fc78fc None None] MFA Rules not processed for user `cfa09bb48d4c4d8cb35b1a8bc5b6702f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:29.480658 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dc9f6785-560a-4a3c-8156-26bdc2fc78fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:29.485535 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1356/2730] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:29.525417 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8458e4e818b74d0a9e1fb2b36ad99a97'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:29.603744 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8458e4e818b74d0a9e1fb2b36ad99a97'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:29.618885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8458e4e818b74d0a9e1fb2b36ad99a97'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:29.619828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8458e4e818b74d0a9e1fb2b36ad99a97'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:29.628871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8458e4e818b74d0a9e1fb2b36ad99a97'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:29.636754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1375/2731] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:29 2022] DELETE /identity/v3/users/8458e4e818b74d0a9e1fb2b36ad99a97 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:29.641744 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:29.642041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:29.642326 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:29.663946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:29.667130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:29.742227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1357/2732] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:29.753610 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:29.755166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:29.825608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:29.829946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4e2c2-72b1-42a3-8636-4f45b1e942c8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:29.834061 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:29.834725 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:29.835013 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:29.838841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:29.846529 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:29.848223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6e5d57-2325-41d0-89e1-e86dde2166ea service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:29.858678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1376/2733] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:30.345841 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:30.347426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:30.379818 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a83f5-43d1-4673-9429-606c9190a722 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:30.399004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:30.400134 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:30.400419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:30.400696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] PATH_INFO: `/v3/projects/b6677214743944e1864147b4fd07e551` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:30.402046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6677214743944e1864147b4fd07e551)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:30.407282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:30.565089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6677214743944e1864147b4fd07e551', 'request_id': 'req-0380909a-ec43-4282-a805-0afc6b8e147b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:30.568548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:30.643872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6677214743944e1864147b4fd07e551', 'request_id': 'req-0380909a-ec43-4282-a805-0afc6b8e147b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:30.649865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6677214743944e1864147b4fd07e551', 'request_id': 'req-0380909a-ec43-4282-a805-0afc6b8e147b'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:30.662061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] The token cache is being invalidate because project b6677214743944e1864147b4fd07e551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:30.662551 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:30.663271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0380909a-ec43-4282-a805-0afc6b8e147b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:30.664958 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1358/2734] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:30 2022] DELETE /identity/v3/projects/b6677214743944e1864147b4fd07e551 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:30.669821 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:30.670301 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:30.670400 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:30.689288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:30.690487 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:30.752813 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1377/2735] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:30.760653 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:30.760943 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:30.761284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:30.783629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:30.784981 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:30.793147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1359/2736] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:30.797842 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:30.808849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea741825-4445-411b-ae94-0d15afac0571 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:30.814279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:30.820568 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:30.831925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1378/2737] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 07:33:30.836627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:30.847153 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4417219-117e-4279-953e-bc20540f61c8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:30.852043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:30.852707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:30.852994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:30.853330 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:30.854026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:30.856191 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:30.933991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1360/2738] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:30 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:30.936996 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:30.947296 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c7a8a-4ee8-45b1-9dfc-88fc1f74b294 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:31.018940 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:31.019927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.020365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.020845 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.021734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:31.025958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:31.084087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1379/2739] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:30 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:31.088578 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:31.100651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38197-d4de-4003-9e0f-4816db625c15 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:31.106011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:31.106986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.107276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.107576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.108309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:31.109964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:31.120869 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1361/2740] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:31.125317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:31.135515 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d177d-9c38-489f-b0bb-2dc6c72bdb29 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:31.140195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:31.141368 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.141649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.141922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.142644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:31.144285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea807ce7-352c-4c34-b4e5-2d3e6087508f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:31.155445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1380/2741] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:31.160299 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:31.170426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad45b7-48c3-4961-bc54-87b6dd734e7b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:31.175124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:31.175999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.176282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.176560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] PATH_INFO: `/v3/projects/5d738fb46723437ca667187032213f65/users/05eaa3aa190c4f38add1e2450ea576fd/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.191087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d738fb46723437ca667187032213f65, user_id=05eaa3aa190c4f38add1e2450ea576fd, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:31.193753 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:31.290519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1362/2742] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:31 2022] PUT /identity/v3/projects/5d738fb46723437ca667187032213f65/users/05eaa3aa190c4f38add1e2450ea576fd/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:31.295829 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.296146 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.296428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.314912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:31.316180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:31.367039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:31.378921 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1381/2743] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:31.388515 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:31.390282 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:31.454729 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f4741-0995-426a-aaed-12c94b6cbbeb admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:31.458802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:31.459407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:31.459689 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:31.459966 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:31.470004 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:31.471496 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddcb16-76ee-4bd1-ae29-a9df5dbdbebf service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:31.481227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1363/2744] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:32.407004 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:32.408506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:32.421125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d254d1a-9421-458a-8d18-c2bf3659d17a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:32.426256 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:32.427157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:32.427433 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:32.427702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] PATH_INFO: `/v3/users/e51e099fde464b82944925a58c80d7a8` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:32.428889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51e099fde464b82944925a58c80d7a8)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:32.430917 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:32.628943 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51e099fde464b82944925a58c80d7a8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:32.682519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:32.683054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:32.683175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:32.689858 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51e099fde464b82944925a58c80d7a8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:32.713458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51e099fde464b82944925a58c80d7a8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:32.713458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51e099fde464b82944925a58c80d7a8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:32.718306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-e38ee459-4718-4c61-96e1-26b3653e2958 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51e099fde464b82944925a58c80d7a8'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:32.724276 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] MFA Rules not processed for user `05eaa3aa190c4f38add1e2450ea576fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:32.725651 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:32.727612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1382/2745] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:32 2022] DELETE /identity/v3/users/e51e099fde464b82944925a58c80d7a8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:32.732708 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:32.732852 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:32.733253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:32.753793 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:32.755062 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:32.809776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1364/2746] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:32.820800 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:32.822712 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:32.838137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:32.840526 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1383/2747] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:32.851396 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:32.853095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:32.892957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52e577-24d6-4582-bb96-49e76ce88bb8 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:32.896784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:32.897512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:32.897798 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:32.898081 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:32.908669 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:32.910448 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:32.925163 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1365/2748] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:33:32.933762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904c438-2f5b-4815-ae61-a6f4568bb461 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:32.938278 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:32.939261 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:32.940009 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:32.940431 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:32.950878 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:32.952609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:32.963549 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1384/2749] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:33:33.411664 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:33.413263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:33.428154 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dbad5-864e-422f-b871-4c493c19cb0b service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:33.432836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:33.433776 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:33.434067 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:33.434350 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] PATH_INFO: `/v3/projects/6412482294f84894810235116b04b5ba` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:33.435573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6412482294f84894810235116b04b5ba)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:33.437709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:33.585988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6412482294f84894810235116b04b5ba', 'request_id': 'req-b4c23456-a8ee-4524-976d-b767ad9f0b71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.637643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6412482294f84894810235116b04b5ba', 'request_id': 'req-b4c23456-a8ee-4524-976d-b767ad9f0b71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.644778 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6412482294f84894810235116b04b5ba', 'request_id': 'req-b4c23456-a8ee-4524-976d-b767ad9f0b71'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.657837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] The token cache is being invalidate because project 6412482294f84894810235116b04b5ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:33.658138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.659209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.661500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1366/2750] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:33 2022] DELETE /identity/v3/projects/6412482294f84894810235116b04b5ba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:33.666029 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:33.676211 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda8972-8478-49fa-81e1-c33b1be7d808 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:33.685075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:33.735087 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:33.735969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:33.736297 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:33.736576 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] PATH_INFO: `/v3/users/113cdbcca91e4d3486789972fde643e3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:33.737831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113cdbcca91e4d3486789972fde643e3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:33.740243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:33.918971 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113cdbcca91e4d3486789972fde643e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.968972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113cdbcca91e4d3486789972fde643e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.982205 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113cdbcca91e4d3486789972fde643e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.982892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113cdbcca91e4d3486789972fde643e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.990275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-17e4fdde-5bac-41cc-a6f7-740477274030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113cdbcca91e4d3486789972fde643e3'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:33.996169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1385/2751] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:33 2022] DELETE /identity/v3/users/113cdbcca91e4d3486789972fde643e3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:34.399164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:34.400642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:34.415607 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c23456-a8ee-4524-976d-b767ad9f0b71 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:34.475372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:34.476272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.476556 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.476830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] PATH_INFO: `/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.478044 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7c6b1a36d384d0ca7de5c2718cbae41)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:34.479920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:34.604263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:34.611437 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7c6b1a36d384d0ca7de5c2718cbae41', 'request_id': 'req-faeabfde-4a31-477a-8b80-ab3895f13d05'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:34.683097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7c6b1a36d384d0ca7de5c2718cbae41', 'request_id': 'req-faeabfde-4a31-477a-8b80-ab3895f13d05'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:34.689637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7c6b1a36d384d0ca7de5c2718cbae41', 'request_id': 'req-faeabfde-4a31-477a-8b80-ab3895f13d05'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:34.702351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] The token cache is being invalidate because project f7c6b1a36d384d0ca7de5c2718cbae41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:34.702648 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:34.703331 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-faeabfde-4a31-477a-8b80-ab3895f13d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:34.703643 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fec00-c368-4817-a258-a28c95b7e319 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.704603 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fec00-c368-4817-a258-a28c95b7e319 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.704879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9fec00-c368-4817-a258-a28c95b7e319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.705732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1367/2752] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:34 2022] DELETE /identity/v3/projects/f7c6b1a36d384d0ca7de5c2718cbae41 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:34.710329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.710709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.710927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.728448 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-8e9fec00-c368-4817-a258-a28c95b7e319 None None] MFA Rules not processed for user `05eaa3aa190c4f38add1e2450ea576fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:34.729638 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:34.729965 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8e9fec00-c368-4817-a258-a28c95b7e319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:34.730837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:34.789469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1386/2753] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:34.796207 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1368/2754] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:34.805832 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.806123 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.806458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.828696 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:34.830145 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:34.838315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1387/2755] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:34.842997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:34.860043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbfbd4-8577-43b5-960c-c2a99a1f081a None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:34.860043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:34.860043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.860043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.860960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.860960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:34.860960 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:34.862486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:34.874727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1369/2756] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:34.880040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:34.892879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ff016-556d-4ab6-8312-93e539a25341 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:34.897822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:34.898483 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:34.898763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:34.899076 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:34.899794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:34.901740 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:34.972316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1388/2757] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:34 2022] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:34.976397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:34.987738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df9015-cc34-4a99-a786-919e4df36951 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.045458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.047458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:35.052176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.052944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.053447 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.053797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.055385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.057453 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.058519 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:35.109798 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24cd70-d7e9-41bd-ab13-b8c1c8af23df admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.113715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.114358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.114642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.114920 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.116704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:35.126619 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.128044 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.135927 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1389/2758] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:35.158808 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1370/2759] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:34 2022] POST /identity/v3/users => generated 294 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:35.163127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.174642 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114591dc-191c-4b98-b2a0-9e235062319a service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.179982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.185551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.185551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.185551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.185551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.185551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.195718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1390/2760] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:35.199918 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.215731 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b36390-9583-42f3-8562-c66f7e9a919c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.218229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.218999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.219258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.219533 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.220267 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.222026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689622f-9ea5-4e9f-bc79-14f2f3ef8707 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.233295 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1371/2761] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:35.238127 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.248805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a235e46-fdbf-4712-b497-afeaf388ebf4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.254402 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.255283 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.255574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.255854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] PATH_INFO: `/v3/projects/897514c6948749c08afad42cc45ac2c9/users/1cb763c56b68436691d1549bbd81434f/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.272179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=897514c6948749c08afad42cc45ac2c9, user_id=1cb763c56b68436691d1549bbd81434f, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.274835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.375064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1391/2762] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:35 2022] PUT /identity/v3/projects/897514c6948749c08afad42cc45ac2c9/users/1cb763c56b68436691d1549bbd81434f/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:35.386623 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.386920 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.387214 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.413656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] MFA Rules not processed for user `1cb763c56b68436691d1549bbd81434f`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:35.414939 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:35.436944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:35.481784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1372/2763] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:35.487042 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.552078 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4956f45-814e-4365-87ae-7e302b65c5b8 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.560909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.560909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.560909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.560909 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.561385 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.562810 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.684484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1392/2764] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:35 2022] POST /identity/v3/projects => generated 389 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:35.687545 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.698997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62800cf1-1067-4744-bf2c-be3e182cfcfd None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.761620 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.762217 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.762504 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.762783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.763485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.765475 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.866536 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1373/2765] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:35 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:35.870548 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.881807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb86e5b-7311-44b1-8773-ec5ffd2cb426 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.887723 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.888394 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.888819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.889140 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.889879 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.892270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:35.904180 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1393/2766] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:35.909089 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:35.919816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed53f7-a674-4113-b70c-59f848fc0bc2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:35.924643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:35.925569 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:35.925849 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:35.926124 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] PATH_INFO: `/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47/users/0e453e5686914b4fa761dd8d79caab77/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:35.941084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9729c0bdde3845e5bc08dcc3f90e9d47, user_id=0e453e5686914b4fa761dd8d79caab77, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:35.943695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:36.021635 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1374/2767] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:35 2022] PUT /identity/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47/users/0e453e5686914b4fa761dd8d79caab77/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:36.025711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:36.036045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf3c81a-094c-480b-9026-80d7ff3619e0 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:36.089866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:36.101648 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:36.104704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.104704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.104704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.104704 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:36.105357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a30e16-cf47-4359-b973-a15e358bc806 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:36.115819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1394/2768] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:36.120324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:36.132426 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70845aea-0b70-4eb2-a0b2-b3ec0f60340b admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:36.137245 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:36.138131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.138411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.138732 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] PATH_INFO: `/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47/users/0e453e5686914b4fa761dd8d79caab77/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.140851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9729c0bdde3845e5bc08dcc3f90e9d47, user_id=0e453e5686914b4fa761dd8d79caab77, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:36.143565 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:36.153667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1375/2769] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:36 2022] PUT /identity/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47/users/0e453e5686914b4fa761dd8d79caab77/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:36.163912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.164200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.164480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.199092 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] MFA Rules not processed for user `0e453e5686914b4fa761dd8d79caab77`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:36.200365 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:36.271952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1395/2770] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:36.282917 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:36.284678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:36.345811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52161e6-8dab-4372-a440-213351a12fe5 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:36.349733 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:36.350090 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.350369 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.350663 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.359494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:36.361765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb6fff7-ab6b-449c-a8fc-8af52c4e88bf service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:36.371212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1376/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:36.519510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:36.584692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75518b-56d9-453f-859e-c8f25435937f None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:36.589191 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:36.590314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.590593 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.590864 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] PATH_INFO: `/v3/users/1cb763c56b68436691d1549bbd81434f` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.592295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb763c56b68436691d1549bbd81434f)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:36.594359 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:36.811962 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb763c56b68436691d1549bbd81434f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:36.895170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb763c56b68436691d1549bbd81434f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:36.913316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb763c56b68436691d1549bbd81434f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:36.914311 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb763c56b68436691d1549bbd81434f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:36.915784 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:36.921817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb763c56b68436691d1549bbd81434f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:36.928236 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1396/2772] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:36 2022] DELETE /identity/v3/users/1cb763c56b68436691d1549bbd81434f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:36.932758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e615-2170-46ee-bc11-02739a061736 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:36.933213 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e615-2170-46ee-bc11-02739a061736 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:36.933355 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434e615-2170-46ee-bc11-02739a061736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:36.951626 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b434e615-2170-46ee-bc11-02739a061736 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:36.952837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b434e615-2170-46ee-bc11-02739a061736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:36.964905 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:37.014296 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1377/2773] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:37.024195 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:37.025771 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:37.084537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4351617-cfef-44d7-b806-dd853a08abbf admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:37.088282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:37.088931 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:37.089246 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:37.089891 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:37.110340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:37.110340 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:37.112115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1397/2774] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:37.593696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e615-2170-46ee-bc11-02739a061736 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:37.595627 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b434e615-2170-46ee-bc11-02739a061736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:37.625449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434e615-2170-46ee-bc11-02739a061736 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:37.625449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:37.625449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:37.625449 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:37.627141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] PATH_INFO: `/v3/projects/897514c6948749c08afad42cc45ac2c9` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:37.627141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=897514c6948749c08afad42cc45ac2c9)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:37.627141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:37.748000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897514c6948749c08afad42cc45ac2c9', 'request_id': 'req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:37.809162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897514c6948749c08afad42cc45ac2c9', 'request_id': 'req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:37.818422 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897514c6948749c08afad42cc45ac2c9', 'request_id': 'req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:37.832758 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] The token cache is being invalidate because project 897514c6948749c08afad42cc45ac2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:37.833232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:37.834590 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:37.836572 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1378/2775] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:37 2022] DELETE /identity/v3/projects/897514c6948749c08afad42cc45ac2c9 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:37.840833 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:37.850617 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22df8-225c-45db-b52e-57071f67973a service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:37.935580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:37.937476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:37.937854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:37.938319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] PATH_INFO: `/v3/users/0e453e5686914b4fa761dd8d79caab77` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:37.946334 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e453e5686914b4fa761dd8d79caab77)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:37.948789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:38.161095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e453e5686914b4fa761dd8d79caab77'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:38.220375 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e453e5686914b4fa761dd8d79caab77'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:38.236200 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e453e5686914b4fa761dd8d79caab77'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:38.237573 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e453e5686914b4fa761dd8d79caab77'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:38.245445 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-67de5c69-3bb5-4034-bd3a-3115807d7393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e453e5686914b4fa761dd8d79caab77'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:38.251493 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1398/2776] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:37 2022] DELETE /identity/v3/users/0e453e5686914b4fa761dd8d79caab77 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:38.737128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:38.739078 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:38.757290 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaaf770-27e6-4bd4-8a5c-40309db7a36a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:38.823456 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:38.824480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:38.824761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:38.825046 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] PATH_INFO: `/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:38.826313 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9729c0bdde3845e5bc08dcc3f90e9d47)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:38.828349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:38.979443 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:38.983767 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9729c0bdde3845e5bc08dcc3f90e9d47', 'request_id': 'req-d085a211-beac-44fa-b364-c0b9ac98c3db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:39.071783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9729c0bdde3845e5bc08dcc3f90e9d47', 'request_id': 'req-d085a211-beac-44fa-b364-c0b9ac98c3db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:39.078162 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9729c0bdde3845e5bc08dcc3f90e9d47', 'request_id': 'req-d085a211-beac-44fa-b364-c0b9ac98c3db'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:39.090624 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] The token cache is being invalidate because project 9729c0bdde3845e5bc08dcc3f90e9d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:39.090915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:39.091710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d085a211-beac-44fa-b364-c0b9ac98c3db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:39.093306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1379/2777] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:38 2022] DELETE /identity/v3/projects/9729c0bdde3845e5bc08dcc3f90e9d47 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:39.099693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.103706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.103706 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.122895 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:39.124120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:39.130079 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:39.190315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1399/2778] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:39.198408 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc988-3f68-429e-9815-218977471407 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.198697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc988-3f68-429e-9815-218977471407 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.198971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cc988-3f68-429e-9815-218977471407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.219371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e93cc988-3f68-429e-9815-218977471407 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:39.220684 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e93cc988-3f68-429e-9815-218977471407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:39.232890 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1380/2779] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:39.237342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.247250 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a69019-89d4-4924-8976-f29eea302ccb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.251828 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.252655 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.252980 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.253287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.254016 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:39.254321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.255905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.267450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1400/2780] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:39.272268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc988-3f68-429e-9815-218977471407 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.281573 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cc988-3f68-429e-9815-218977471407 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.287255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.287926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.288246 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.288523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.294622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.294622 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.382982 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1381/2781] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:39.387213 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.398327 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae01fb-285c-4640-87fb-8bf894bcbae4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.461857 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.462536 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.462947 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.463228 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.463918 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.466492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.598752 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1401/2782] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:39.602972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.613562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d377ce5-7705-439a-8d6b-7489f2339211 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.618117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.618866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.619115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.619396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.620130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.621839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.635215 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1382/2783] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:39.638589 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.649691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330ff0-6da7-4d79-b80c-e45471b0e2f7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.656244 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.656970 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.661215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.661215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.661215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.661215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ca161d-43bd-4af6-b189-dae5e160afa4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.671209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1402/2784] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:39.675464 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:39.687063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900b44a-e737-4c10-ae59-1927a8aa9342 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:39.694513 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:39.700069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.700379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.700647 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] PATH_INFO: `/v3/projects/9c8eb12e9018483aa102fc07fa5f36aa/users/95bb0e1c9510400896b45ee2f7db77e3/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.728617 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8eb12e9018483aa102fc07fa5f36aa, user_id=95bb0e1c9510400896b45ee2f7db77e3, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:39.732361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:39.851793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1383/2785] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:39 2022] PUT /identity/v3/projects/9c8eb12e9018483aa102fc07fa5f36aa/users/95bb0e1c9510400896b45ee2f7db77e3/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:39.863067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:39.863379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:39.863718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:39.899632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] MFA Rules not processed for user `95bb0e1c9510400896b45ee2f7db77e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:39.900925 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:39.972625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1403/2786] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:39.974679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.045177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5a773-7e94-409a-a142-a035b05798b9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.051055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.051726 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.052011 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.052288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.053041 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.055082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.137050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1384/2787] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:39 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:40.141120 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.153476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aedd8e-5e1f-42d8-88db-f132e770423e None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.158599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:40.223242 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.224097 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.224467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.224822 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.225697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.227733 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.297984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1404/2788] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:40 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:40.299105 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.309477 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d783dd2-0ffa-4e47-8902-5b8233787cdc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.318574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.318574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.318574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.318574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.318997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.318997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.329342 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1385/2789] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:40.333883 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.344098 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de28ea-9541-4bbf-8fb5-d0e86a8c79b4 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.348776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.349476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.349763 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.350039 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.350776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.352352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737035e-1f80-421d-bd7b-7dc320be8824 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.362805 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1405/2790] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 07:33:40.367065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.377055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411972f5-28b0-477c-a272-fdd813b42aab admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.383135 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.384022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.384301 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.384575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] PATH_INFO: `/v3/projects/c3861c461ebe4b27aed8084af1f7ced3/users/6c2bcd1c78fa442b939fa6838773303e/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.399892 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3861c461ebe4b27aed8084af1f7ced3, user_id=6c2bcd1c78fa442b939fa6838773303e, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.402567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.483828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1386/2791] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:40 2022] PUT /identity/v3/projects/c3861c461ebe4b27aed8084af1f7ced3/users/6c2bcd1c78fa442b939fa6838773303e/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:40.551565 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.551774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.552034 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.579746 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] MFA Rules not processed for user `6c2bcd1c78fa442b939fa6838773303e`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:40.580893 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:40.645644 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1406/2792] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:33:40.650177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.669410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:40.711220 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68002ad9-8df0-470e-a400-a6dc1e450912 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.716156 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.716811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.717130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.717409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.718115 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.719999 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.822903 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1387/2793] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:40 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:40.826887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.839169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d685b-b157-434b-8a0c-80cfe38b174a None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:40.894150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:40.895287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:40.895287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:40.895462 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:40.896056 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:40.898002 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:40.981101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1407/2794] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:40 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:40.984872 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:40.995902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e348262-8ce1-4a91-a23a-cf11265ff033 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:41.000405 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:41.001088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.001376 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.001654 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.002458 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:41.004097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:41.014420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1388/2795] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:41.018653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:41.025075 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:41.028693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83e937-498b-483a-9ab6-4c74b7bfea9a admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:41.033316 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:41.034973 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.035257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.035534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] PATH_INFO: `/v3/projects/47cf91f281ea4f90a610386055927d11/users/c0400ba397014248a8cc7f1b002aaf7c/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.050939 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cf91f281ea4f90a610386055927d11, user_id=c0400ba397014248a8cc7f1b002aaf7c, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:41.053838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:41.117792 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1408/2796] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:41 2022] PUT /identity/v3/projects/47cf91f281ea4f90a610386055927d11/users/c0400ba397014248a8cc7f1b002aaf7c/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:41.121810 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:41.132548 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f570f-49a0-41a9-8227-00cc698ee86a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:41.187092 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:41.187748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.188031 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.188307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.189185 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:41.191438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ded94-252b-413e-a12d-05a176dd27e7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:41.200885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1389/2797] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:41.205182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:41.216516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8122726-0fb8-458b-b6a4-b77e6bd30443 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:41.221338 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:41.222241 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.222531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.222819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] PATH_INFO: `/v3/projects/47cf91f281ea4f90a610386055927d11/users/c0400ba397014248a8cc7f1b002aaf7c/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.224818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cf91f281ea4f90a610386055927d11, user_id=c0400ba397014248a8cc7f1b002aaf7c, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:41.227502 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:41.237854 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1409/2798] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:41 2022] PUT /identity/v3/projects/47cf91f281ea4f90a610386055927d11/users/c0400ba397014248a8cc7f1b002aaf7c/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:41.248009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.248300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.248576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.278554 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] MFA Rules not processed for user `c0400ba397014248a8cc7f1b002aaf7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:41.279811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:41.352852 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1390/2799] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:41.365599 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:41.367457 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:41.427667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fd54e-3e3c-46fa-85bf-5e9f74ebf914 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:41.431324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:41.432049 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:41.432328 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:41.432598 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:41.487961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:41.489428 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:41.498232 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1410/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:43.381304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:43.391991 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dac6dd-ccf3-4015-af5d-f595eb7fea09 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:43.396221 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:43.396882 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:43.397243 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:43.397516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:43.407734 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:43.459137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:43.460604 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:43.469685 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1391/2801] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:44.717093 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:44.718531 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:44.729809 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d75752-2d90-444d-8451-c2a1c9ee0af8 service cinder] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:44.733356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:44.734025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:44.734304 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:44.734577 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:44.744090 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:44.745592 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955f408-d43f-4e50-b774-df28acb78a9c service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:44.756460 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1411/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:49.379339 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:49.454871 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde58739-0ae8-470a-8f81-3cc5694cad38 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:49.460583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:49.462358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:49.462358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:49.462358 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] PATH_INFO: `/v3/users/95bb0e1c9510400896b45ee2f7db77e3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:49.463976 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bb0e1c9510400896b45ee2f7db77e3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:49.467403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:49.666030 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bb0e1c9510400896b45ee2f7db77e3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:49.742940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bb0e1c9510400896b45ee2f7db77e3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:49.748008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bb0e1c9510400896b45ee2f7db77e3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:49.769351 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bb0e1c9510400896b45ee2f7db77e3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:49.778628 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bb0e1c9510400896b45ee2f7db77e3'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:49.785978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1392/2803] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:49 2022] DELETE /identity/v3/users/95bb0e1c9510400896b45ee2f7db77e3 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:49.790559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:49.791066 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:49.791160 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:49.810710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:49.812217 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:49.884765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1412/2804] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:49.894843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:49.896281 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:49.933540 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:49.970463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185fdec-3656-441f-9120-75dba2e5b079 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:49.978082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:49.992386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:49.992386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:49.992386 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:50.023702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:50.025576 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:50.038526 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1393/2805] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:50.490289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:50.494476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:50.504776 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b50c8-170d-40be-9020-2c18d4785049 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:50.509626 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:50.511679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:50.511679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:50.511679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] PATH_INFO: `/v3/projects/9c8eb12e9018483aa102fc07fa5f36aa` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:50.512348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8eb12e9018483aa102fc07fa5f36aa)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:50.514333 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:50.517124 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:50.632761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8eb12e9018483aa102fc07fa5f36aa', 'request_id': 'req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:50.699860 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8eb12e9018483aa102fc07fa5f36aa', 'request_id': 'req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:50.706678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8eb12e9018483aa102fc07fa5f36aa', 'request_id': 'req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:50.718214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] The token cache is being invalidate because project 9c8eb12e9018483aa102fc07fa5f36aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:50.718503 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:50.719167 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:50.720715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1413/2806] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:50 2022] DELETE /identity/v3/projects/9c8eb12e9018483aa102fc07fa5f36aa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:50.725500 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:50.735349 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce6d1a-1231-4b1a-85f4-41eeda1c4598 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:50.795754 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:50.796629 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:50.796911 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:50.797226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] PATH_INFO: `/v3/users/6c2bcd1c78fa442b939fa6838773303e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:50.798403 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c2bcd1c78fa442b939fa6838773303e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:50.800586 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:50.999655 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c2bcd1c78fa442b939fa6838773303e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.059879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c2bcd1c78fa442b939fa6838773303e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.060575 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c2bcd1c78fa442b939fa6838773303e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.074022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c2bcd1c78fa442b939fa6838773303e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.080945 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c2bcd1c78fa442b939fa6838773303e'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.087247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1394/2807] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:50 2022] DELETE /identity/v3/users/6c2bcd1c78fa442b939fa6838773303e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:51.659151 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:51.660849 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:51.681983 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c7b5c-5b40-4c65-a6c6-f4134f0918ef admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:51.761272 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:51.762064 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:51.762352 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:51.762628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] PATH_INFO: `/v3/projects/c3861c461ebe4b27aed8084af1f7ced3` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:51.764362 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3861c461ebe4b27aed8084af1f7ced3)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:51.766489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:51.869165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3861c461ebe4b27aed8084af1f7ced3', 'request_id': 'req-2d8092cd-7c02-443b-9ce8-36554cef1c5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.923223 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3861c461ebe4b27aed8084af1f7ced3', 'request_id': 'req-2d8092cd-7c02-443b-9ce8-36554cef1c5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.934165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3861c461ebe4b27aed8084af1f7ced3', 'request_id': 'req-2d8092cd-7c02-443b-9ce8-36554cef1c5b'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.959689 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] The token cache is being invalidate because project c3861c461ebe4b27aed8084af1f7ced3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:51.960264 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.966293 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:51.966816 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1414/2808] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:51 2022] DELETE /identity/v3/projects/c3861c461ebe4b27aed8084af1f7ced3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:51.967388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:51.969844 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:51.988583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c5551-6815-435f-a114-59224a8f3305 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:52.026676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:52.028150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:52.063097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:52.066737 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:52.072957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:52.074040 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:52.074325 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:52.074601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] PATH_INFO: `/v3/users/c0400ba397014248a8cc7f1b002aaf7c` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:52.075959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0400ba397014248a8cc7f1b002aaf7c)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:52.077957 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:52.118982 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8092cd-7c02-443b-9ce8-36554cef1c5b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:52.125243 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:52.125899 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:52.126185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:52.126461 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:52.128942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:52.141308 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:52.142977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:52.153667 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1415/2809] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:52.278879 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0400ba397014248a8cc7f1b002aaf7c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:52.345517 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0400ba397014248a8cc7f1b002aaf7c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:52.346138 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0400ba397014248a8cc7f1b002aaf7c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:52.358087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0400ba397014248a8cc7f1b002aaf7c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:52.365117 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-6fc26789-35c0-4d7e-afd4-d0a1fec15e02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0400ba397014248a8cc7f1b002aaf7c'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:52.371357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1395/2810] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:33:51 2022] DELETE /identity/v3/users/c0400ba397014248a8cc7f1b002aaf7c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:52.770719 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:52.772186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:52.786489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44667a5d-487b-4bf2-8dd2-859dad3d4f86 service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:52.845580 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:52.848001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:52.848001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:52.848001 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] PATH_INFO: `/v3/projects/47cf91f281ea4f90a610386055927d11` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:52.848370 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cf91f281ea4f90a610386055927d11)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:52.850399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:52.971728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cf91f281ea4f90a610386055927d11', 'request_id': 'req-4b204482-0edf-4d89-b9b4-641398c5982a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:53.077534 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cf91f281ea4f90a610386055927d11', 'request_id': 'req-4b204482-0edf-4d89-b9b4-641398c5982a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:53.086468 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cf91f281ea4f90a610386055927d11', 'request_id': 'req-4b204482-0edf-4d89-b9b4-641398c5982a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:53.102711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] The token cache is being invalidate because project 47cf91f281ea4f90a610386055927d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:33:53.103008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:53.103652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-4b204482-0edf-4d89-b9b4-641398c5982a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:33:53.105285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1416/2811] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:33:52 2022] DELETE /identity/v3/projects/47cf91f281ea4f90a610386055927d11 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:33:53.110679 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.111480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.111480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.130266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:53.131494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:53.198307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1396/2812] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:53.206115 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.207880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.207880 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.231040 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:53.232945 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:53.247166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1417/2813] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:53.251420 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.261444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fd843-545c-4a6a-9212-0af16922575e None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.266125 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.266793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.267084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.267362 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.268633 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80337) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:33:53.268964 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.270725 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.283309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1397/2814] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:33:53.288504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.297897 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fa5ab-e575-40a4-809f-719fdeef413c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.302885 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.303540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.303819 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.304193 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] PATH_INFO: `/v3/projects` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.304889 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.306908 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.416964 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1418/2815] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:33:53 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:33:53.421466 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.431559 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f470b49-77d2-48dc-b385-80c455809b46 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.487034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.487672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.487952 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.488223 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.488906 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.490811 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.497332 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:53.574986 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1398/2816] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:33:53 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:33:53.578979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.591343 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4459e1-773b-4b70-80c4-93c4a30b067d admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.597103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.597848 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.598138 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.598420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.599163 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.600785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.603731 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:33:53.618963 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1419/2817] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:53.620333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.631867 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e60f06e-1704-45c2-91e7-03b025547ee7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.636959 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.637747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.638157 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.638446 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.639180 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.640874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695383cf-1a10-431e-ab97-3d5bb8d05764 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.652735 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1399/2818] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:33:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:33:53.657413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.671946 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde31d0-c86c-4fd2-8e39-caeb68856876 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.672761 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.673678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.673959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.674348 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] PATH_INFO: `/v3/projects/62d6f0bb8e004408b4f8844e4bba0b09/users/7a835b5391584a75a39972d29035dc4c/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.689404 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d6f0bb8e004408b4f8844e4bba0b09, user_id=7a835b5391584a75a39972d29035dc4c, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.695057 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.786972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1420/2819] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:33:53 2022] PUT /identity/v3/projects/62d6f0bb8e004408b4f8844e4bba0b09/users/7a835b5391584a75a39972d29035dc4c/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:33:53.798139 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5556d0-e084-4866-9b65-2213831d9702 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.798455 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5556d0-e084-4866-9b65-2213831d9702 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.803965 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5556d0-e084-4866-9b65-2213831d9702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.826594 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-eb5556d0-e084-4866-9b65-2213831d9702 None None] MFA Rules not processed for user `7a835b5391584a75a39972d29035dc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:53.827839 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eb5556d0-e084-4866-9b65-2213831d9702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:53.894228 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1400/2820] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:53.904850 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:33:53.906554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:53.962189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44717e-867b-4d18-a749-bc63f8bf94c2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:33:53.965994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:33:53.966636 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:53.966916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:53.967189 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:53.975754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:33:53.977220 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9cf2b1-af3c-4ff4-a37b-d48982334ba1 service cinder] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:33:53.986330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1421/2821] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:33:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:33:54.679797 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:54.680257 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:54.680518 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:54.698968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] MFA Rules not processed for user `05eaa3aa190c4f38add1e2450ea576fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:54.700181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:54.756560 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1401/2822] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:33:55.719508 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2d4d6-6a5e-4dc1-b7f8-42cb34b587e6 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:33:55.720033 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2d4d6-6a5e-4dc1-b7f8-42cb34b587e6 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:33:55.720150 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2d4d6-6a5e-4dc1-b7f8-42cb34b587e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:33:55.738381 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b8e2d4d6-6a5e-4dc1-b7f8-42cb34b587e6 None None] MFA Rules not processed for user `7a835b5391584a75a39972d29035dc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:33:55.739569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b8e2d4d6-6a5e-4dc1-b7f8-42cb34b587e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:33:55.746466 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1422/2823] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:33:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:00.713319 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:00.715274 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:00.787830 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966ba8-10af-4ce0-b619-234c447ffaf3 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:00.791773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:00.792472 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:00.792761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:00.793084 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:00.798748 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:00.831824 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:00.873567 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:00.874997 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:00.884682 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1402/2824] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:05.733319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=40,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:10.945251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=17 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:15.824012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f743785-3877-4a0d-8da0-b123c522bf65 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:15.824517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f743785-3877-4a0d-8da0-b123c522bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:15.824640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f743785-3877-4a0d-8da0-b123c522bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:15.853748 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-2f743785-3877-4a0d-8da0-b123c522bf65 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:15.858537 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2f743785-3877-4a0d-8da0-b123c522bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:15.923905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1423/2825] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:34:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:16.092150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:16.093644 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:16.165893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d1245-5734-4c5a-a64f-2c253628d503 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:16.170912 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:16.172488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:16.172695 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:16.172994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:16.182544 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:16.184181 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:16.193834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1403/2826] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:16.906794 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77a20-8537-49db-aab4-a7bafcb06d03 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:16.907262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77a20-8537-49db-aab4-a7bafcb06d03 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:16.907386 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf77a20-8537-49db-aab4-a7bafcb06d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:16.925489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-bdf77a20-8537-49db-aab4-a7bafcb06d03 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:16.926681 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-bdf77a20-8537-49db-aab4-a7bafcb06d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:16.934884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1424/2827] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:34:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:16.949158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:16.960603 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d53f57-7eab-438b-8936-b3dc994d3e3c service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:16.965851 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:16.966491 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:16.966799 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:16.967069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:16.975793 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:16.977642 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:16.985661 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1404/2828] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:17.048469 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ffa2d-b216-4b7c-90b6-665d2e1ad8e9 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:17.048745 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ffa2d-b216-4b7c-90b6-665d2e1ad8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:17.049051 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ffa2d-b216-4b7c-90b6-665d2e1ad8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:17.067591 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b82ffa2d-b216-4b7c-90b6-665d2e1ad8e9 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:17.068765 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b82ffa2d-b216-4b7c-90b6-665d2e1ad8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:17.076357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1425/2829] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:17.091236 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:17.102303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77480ba3-fa8d-4120-9a3e-e8deded942b2 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:17.107340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:17.108106 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:17.108389 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:17.108667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:17.117615 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:17.119266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:17.127396 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1405/2830] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:17.599125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d667-d365-4e93-8f9e-706b300f1665 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:17.599421 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d667-d365-4e93-8f9e-706b300f1665 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:17.599705 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d63d667-d365-4e93-8f9e-706b300f1665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:17.619471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-3d63d667-d365-4e93-8f9e-706b300f1665 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:17.620616 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-3d63d667-d365-4e93-8f9e-706b300f1665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:17.629050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1426/2831] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:34:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:17.642530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:17.658186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ca313-9496-45a0-b118-53fdcb9502f4 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:17.664314 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:17.664992 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:17.665306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:17.665583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:17.684270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:17.688510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:17.701141 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1406/2832] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:18.257170 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:18.257692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:18.257692 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:18.278053 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:18.279588 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:18.292637 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1427/2833] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:34:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:18.302909 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:18.316756 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1517a-be6f-421a-9717-5d38eacd7b28 service swift] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:18.324161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:18.325678 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:18.326471 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:18.327005 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:18.340708 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:18.343140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9482b7-0848-4ba0-9816-829d360e7ac8 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:18.356297 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1407/2834] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:21.371014 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:21.447227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3403d-fe2e-4d33-b053-835ebb536bdb None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:21.451866 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:21.452840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:21.453218 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:21.453551 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] PATH_INFO: `/v3/users/7a835b5391584a75a39972d29035dc4c` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:21.454826 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a835b5391584a75a39972d29035dc4c)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:21.457694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:21.614711 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a835b5391584a75a39972d29035dc4c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:21.659923 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a835b5391584a75a39972d29035dc4c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:21.670513 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:21.676262 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a835b5391584a75a39972d29035dc4c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:21.676412 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a835b5391584a75a39972d29035dc4c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:21.683572 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a835b5391584a75a39972d29035dc4c'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:21.691977 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1428/2835] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:34:21 2022] DELETE /identity/v3/users/7a835b5391584a75a39972d29035dc4c => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:21.696486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:21.696994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:21.697143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:21.716278 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:21.717502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:21.792335 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1408/2836] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:21.801770 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:21.803504 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:21.871104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517aa29-5ed7-4cc4-a2ea-19abf26fabce admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:21.875554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:21.876319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:21.876686 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:21.877173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:21.887707 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:21.889227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ada4a-2ea3-4a27-a070-08867c250f2c service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:21.900194 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1429/2837] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:22.194528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:22.196790 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:22.233063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b62c3b-dfcf-43dd-a142-bf9fc855eb7c None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:22.243363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:22.244363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.244746 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.245159 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] PATH_INFO: `/v3/projects/62d6f0bb8e004408b4f8844e4bba0b09` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.246571 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d6f0bb8e004408b4f8844e4bba0b09)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:22.248784 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:22.355743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:22.371233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d6f0bb8e004408b4f8844e4bba0b09', 'request_id': 'req-d9cc433e-116f-4a96-ba2c-48ac8407c82d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:22.443186 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d6f0bb8e004408b4f8844e4bba0b09', 'request_id': 'req-d9cc433e-116f-4a96-ba2c-48ac8407c82d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:22.450410 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d6f0bb8e004408b4f8844e4bba0b09', 'request_id': 'req-d9cc433e-116f-4a96-ba2c-48ac8407c82d'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:22.466017 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] The token cache is being invalidate because project 62d6f0bb8e004408b4f8844e4bba0b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:34:22.466352 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:22.467755 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-d9cc433e-116f-4a96-ba2c-48ac8407c82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:22.469928 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1409/2838] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:34:22 2022] DELETE /identity/v3/projects/62d6f0bb8e004408b4f8844e4bba0b09 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:22.475155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.475836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.475836 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.496888 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:22.498317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:22.573442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1430/2839] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:34:22.581687 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.581975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.582320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.603286 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:22.604512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:22.613861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1410/2840] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:22.618743 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:22.629981 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932380f3-34ea-42eb-83ce-a3fc88a7ded7 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:22.635350 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:22.636317 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.636840 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.637378 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.638612 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:34:22.638929 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:22.640638 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:22.656095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1431/2841] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:34:22.661356 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:22.672530 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49f0b2-e8e4-4973-991e-1b1eb548fdf0 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:22.679063 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:22.679886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.680272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.680643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.681486 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:22.683528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:22.834697 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1411/2842] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:34:22 2022] POST /identity/v3/projects => generated 389 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:22.838630 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:22.853222 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292301c-b347-4b09-b688-e4f69061a305 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:22.917187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:22.917984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:22.918374 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:22.918728 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:22.919554 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:22.921522 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:23.043806 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1432/2843] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:34:22 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:23.049597 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:23.062379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdaca7-b9b1-49d2-b352-c49b8d325507 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:23.068205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:23.068956 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:23.069373 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:23.069652 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:23.070400 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:23.072060 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:23.084363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1412/2844] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:23.088807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:23.095450 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:23.103155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979489d-bcd3-4102-9523-3e5050d95510 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:23.108045 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:23.108718 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:23.109006 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:23.109319 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:23.110054 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:23.111654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a533d5-5661-4272-8660-e8e0ca6959e9 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:23.123649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1433/2845] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:23.128250 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:23.138763 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b043f03f-144e-4847-8a57-d810311cd2e7 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:23.143233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:23.144160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:23.144465 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:23.144770 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] PATH_INFO: `/v3/projects/9c046d677f8b4759aba249edd6a6cdc4/users/53a3f29e040643d6a3ed1e66ba95a433/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:23.160942 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c046d677f8b4759aba249edd6a6cdc4, user_id=53a3f29e040643d6a3ed1e66ba95a433, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:23.163820 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:23.431187 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1413/2846] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:34:23 2022] PUT /identity/v3/projects/9c046d677f8b4759aba249edd6a6cdc4/users/53a3f29e040643d6a3ed1e66ba95a433/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:23.442202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0242-94dc-4878-a5d1-ce0b69304bd5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:23.445187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0242-94dc-4878-a5d1-ce0b69304bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:23.445187 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc0242-94dc-4878-a5d1-ce0b69304bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:23.472679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9ecc0242-94dc-4878-a5d1-ce0b69304bd5 None None] MFA Rules not processed for user `53a3f29e040643d6a3ed1e66ba95a433`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:23.473905 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9ecc0242-94dc-4878-a5d1-ce0b69304bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:23.545279 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1434/2847] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:23.556641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:23.558061 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:23.622093 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9bee55-76a4-4b7d-a5ee-f2e98d955a48 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:23.627000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa4c9120fd7344858fb5054d32faed64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:23.628409 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:23.628924 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:23.629264 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:23.638711 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:23.640271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:23.650902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1414/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:33.542216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=36 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:33.646077 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:35.232846 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3836-de57-4084-b293-66feea2a967c None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:35.233330 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3836-de57-4084-b293-66feea2a967c None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:35.233467 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ad3836-de57-4084-b293-66feea2a967c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:35.251373 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-17ad3836-de57-4084-b293-66feea2a967c None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:35.253226 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-17ad3836-de57-4084-b293-66feea2a967c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:35.308047 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1435/2849] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:35.320439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:35.321861 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:35.391390 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c159be-2b0c-411a-b8b0-de61527ed527 service cinder] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:35.398459 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:35.399075 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:35.399357 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:35.399634 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:35.407673 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3836-de57-4084-b293-66feea2a967c None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:35.408553 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:35.410765 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af257ad-cbb5-4335-a323-fba2cdeebc27 service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:35.419131 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1415/2850] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:35.473182 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ad3836-de57-4084-b293-66feea2a967c None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:35.477785 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:35.478694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:35.478984 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:35.479259 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] PATH_INFO: `/v3/users/53a3f29e040643d6a3ed1e66ba95a433` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:35.480476 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53a3f29e040643d6a3ed1e66ba95a433)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:35.482439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:35.697505 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53a3f29e040643d6a3ed1e66ba95a433'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:35.773600 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53a3f29e040643d6a3ed1e66ba95a433'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:35.786814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53a3f29e040643d6a3ed1e66ba95a433'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:35.787492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53a3f29e040643d6a3ed1e66ba95a433'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:35.794570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53a3f29e040643d6a3ed1e66ba95a433'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:35.800674 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1436/2851] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:34:35 2022] DELETE /identity/v3/users/53a3f29e040643d6a3ed1e66ba95a433 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:34:35.805168 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:35.805488 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:35.805769 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:35.823109 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:35.824287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:35.884523 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1416/2852] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:35.894790 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:35.896185 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:35.924012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:35.953820 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f64564-2449-47ff-a5ba-94707d62f247 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:35.957796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:35.958480 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:35.958762 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:35.959038 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:35.969569 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:35.971007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c582326-a405-4733-8a85-62deb2b7fb2b service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:35.981570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1437/2853] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 07:34:36.427085 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:36.428581 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:36.440940 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b833d-8f08-431d-b8f8-c5ed7ba4f4ec None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:36.452860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:36.453710 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.453995 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.454272 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] PATH_INFO: `/v3/projects/9c046d677f8b4759aba249edd6a6cdc4` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.455707 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c046d677f8b4759aba249edd6a6cdc4)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:36.457416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:36.578954 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c046d677f8b4759aba249edd6a6cdc4', 'request_id': 'req-e468e45c-5820-4c61-89f2-33546f6761a8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:36.630463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c046d677f8b4759aba249edd6a6cdc4', 'request_id': 'req-e468e45c-5820-4c61-89f2-33546f6761a8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:36.636487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c046d677f8b4759aba249edd6a6cdc4', 'request_id': 'req-e468e45c-5820-4c61-89f2-33546f6761a8'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:36.647771 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] The token cache is being invalidate because project 9c046d677f8b4759aba249edd6a6cdc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:34:36.648062 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:36.648724 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-e468e45c-5820-4c61-89f2-33546f6761a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:36.650284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1417/2854] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:34:36 2022] DELETE /identity/v3/projects/9c046d677f8b4759aba249edd6a6cdc4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:36.655324 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.655807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.655942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.676416 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:36.677640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:36.748321 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1438/2855] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:36.750019 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.750315 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.750599 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.773923 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:36.775143 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:36.783247 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1418/2856] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:36.792887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:36.803357 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b3d86-aa6a-49ce-bb1f-1cfb99d043c5 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:36.808186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:36.808844 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.809166 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.809441 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.810173 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:34:36.810479 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:36.812074 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:36.824631 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1439/2857] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:34:36.828921 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:36.838375 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b297c-9c4a-4f13-a884-e874474f406b None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:36.843322 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:36.843968 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.844251 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.844528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.845258 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:36.847306 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:36.850505 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:36.917791 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1419/2858] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:34:36 2022] POST /identity/v3/projects => generated 383 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:36.922068 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:36.932903 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc60d33-1d79-4be3-8893-d8ea7f6d432b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:36.990341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:36.991994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:36.991994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:36.991994 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:36.992306 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:36.994341 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:37.059199 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1440/2859] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:34:36 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 07:34:37.063268 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:37.074816 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e209389-aae0-4b05-b4a3-469522da5bc9 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:37.080256 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:37.080915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:37.081226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:37.081502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:37.082285 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:37.083915 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:37.219009 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1420/2860] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:37.220155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:37.231175 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b364d59-d6c2-487c-992a-2572fc7d546e admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:37.235754 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:37.236408 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:37.237376 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:37.237634 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:37.238366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:37.239952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f7f60-ac31-4c8d-b526-c73938fe54db admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:37.249886 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1441/2861] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:37.254232 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:37.264177 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd5a36-9de3-4f0d-b249-29279f884df8 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:37.269150 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:37.270055 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:37.270329 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:37.270596 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] PATH_INFO: `/v3/projects/49b71b80bc6d4e50b98c15eabab47a83/users/5f79798a1b8b48578b216f8df23bf286/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:37.285308 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b71b80bc6d4e50b98c15eabab47a83, user_id=5f79798a1b8b48578b216f8df23bf286, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:37.287944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:37.369147 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1421/2862] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:34:37 2022] PUT /identity/v3/projects/49b71b80bc6d4e50b98c15eabab47a83/users/5f79798a1b8b48578b216f8df23bf286/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:37.374219 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:37.374510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:37.374791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:37.393916 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:37.395197 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:37.425399 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:37.457424 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1442/2863] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:37.467371 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:37.469132 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:37.525738 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be306a-849d-46dd-8621-25d1b88b9b8c admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:37.529227 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:37.529863 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:37.530142 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:37.530413 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:37.539176 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:37.540593 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:37.550802 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1422/2864] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:38.820557 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:38.822285 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:38.836800 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4432-c2f7-46ca-9384-a78334e83723 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:38.841884 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:38.842703 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:38.843201 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:38.843494 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] PATH_INFO: `/v3/users/05eaa3aa190c4f38add1e2450ea576fd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:38.844685 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05eaa3aa190c4f38add1e2450ea576fd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:38.846817 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:39.016834 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05eaa3aa190c4f38add1e2450ea576fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.088096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05eaa3aa190c4f38add1e2450ea576fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.104125 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05eaa3aa190c4f38add1e2450ea576fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.105081 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05eaa3aa190c4f38add1e2450ea576fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.114022 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8cc07f85-28b8-4afd-b396-41f949dd914f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05eaa3aa190c4f38add1e2450ea576fd'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.120887 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1443/2865] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:34:38 2022] DELETE /identity/v3/users/05eaa3aa190c4f38add1e2450ea576fd => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:39.382266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:39.401897 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e5ca-5727-4e08-9385-c6b5c89883fc service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:39.473574 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:39.474438 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:39.474718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:39.474993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] PATH_INFO: `/v3/projects/5d738fb46723437ca667187032213f65` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:39.476212 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d738fb46723437ca667187032213f65)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:39.479534 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:39.592874 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d738fb46723437ca667187032213f65', 'request_id': 'req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.596721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:39.683015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d738fb46723437ca667187032213f65', 'request_id': 'req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.690828 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d738fb46723437ca667187032213f65', 'request_id': 'req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.719583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] The token cache is being invalidate because project 5d738fb46723437ca667187032213f65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:34:39.719583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.725865 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-a759c21e-7d51-43bd-b6e4-95ac44c6a8e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:34:39.727853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1423/2866] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:34:39 2022] DELETE /identity/v3/projects/5d738fb46723437ca667187032213f65 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:39.733432 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:39.733710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:39.733991 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:39.754439 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:39.755961 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:39.823892 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1444/2867] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:34:39.891702 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:39.891993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:39.892266 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:39.924742 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:39.926065 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:39.941229 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1424/2868] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:39.945516 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:39.956418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38fdf45-1bf2-4639-94b4-b79daf2446ff None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:39.962171 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:39.964571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:39.964571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:39.964571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:39.964571 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80336) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 07:34:39.965380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:39.968157 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:39.986269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1445/2869] 10.222.0.27 () {58 vars in 1152 bytes} [Tue Jul 12 07:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 07:34:39.990643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.001327 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d4a95-65bf-448d-9af7-4a279e29b4ff None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.007363 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.008057 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.008344 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.009463 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.010204 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.012745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.108397 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1425/2870] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:34:39 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:40.112814 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.132688 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb7f58-98b7-4ad8-9a7a-862acd9b78cc admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.170443 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:40.199291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.199968 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.200253 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.200530 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.201358 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.203288 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.277862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1446/2871] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:34:40 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:40.281881 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.296158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934fe5b1-b760-4e88-9609-0ac91a6a21b4 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.301667 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.303170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.303170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.303170 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.303694 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.305309 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.318591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1426/2872] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:40.322732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.334046 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fd674-9671-48c2-888e-e67d56ed18be admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.338818 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.339472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.339775 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.340287 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] PATH_INFO: `/v3/roles` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.341012 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.342678 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568989eb-04fd-4505-86bc-9b9e945c262d admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.358269 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1447/2873] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:40.359745 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.370521 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f6bab-fb5a-47b3-b392-28d9b5f31967 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.375720 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.376764 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.377076 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.378269 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] PATH_INFO: `/v3/projects/c6336c34a0f041db9e864244f710d3f3/users/2516a6fa225f462e867e8b2ee9d0589a/roles/e5ea235ccd4840438ecdecc166e6794e` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.395672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6336c34a0f041db9e864244f710d3f3, user_id=2516a6fa225f462e867e8b2ee9d0589a, role_id=e5ea235ccd4840438ecdecc166e6794e)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.398721 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.495994 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1427/2874] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:34:40 2022] PUT /identity/v3/projects/c6336c34a0f041db9e864244f710d3f3/users/2516a6fa225f462e867e8b2ee9d0589a/roles/e5ea235ccd4840438ecdecc166e6794e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 07:34:40.507088 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc1fd-2fc0-46a9-bac0-6016bf60b64f None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.507380 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc1fd-2fc0-46a9-bac0-6016bf60b64f None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.507679 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeabc1fd-2fc0-46a9-bac0-6016bf60b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.538418 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-aeabc1fd-2fc0-46a9-bac0-6016bf60b64f None None] MFA Rules not processed for user `2516a6fa225f462e867e8b2ee9d0589a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:40.539944 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-aeabc1fd-2fc0-46a9-bac0-6016bf60b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:40.624796 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1448/2875] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:40.637479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:40.640230 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:40.706196 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c805-5d17-41a9-b1a3-3d7ee664c675 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:40.710034 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:40.710853 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:40.711146 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:40.711427 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:40.727175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:40.727175 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:40.734398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1428/2876] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:43.097691 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.098234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.098234 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.130027 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] MFA Rules not processed for user `5f79798a1b8b48578b216f8df23bf286`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:43.131335 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:43.204632 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1449/2877] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:43.209688 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.211317 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:43.282140 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670ba9a-76bc-4585-95ae-150646947f78 service glance] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.287219 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.287883 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.288164 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.288439 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.289160 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.291043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.387450 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1429/2878] 10.222.0.27 () {60 vars in 1152 bytes} [Tue Jul 12 07:34:43 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:43.391654 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.403876 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6b093f-3723-4361-a837-11476c79f8cf None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.435791 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:43.463101 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.463998 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.464144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.464379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] PATH_INFO: `/v3/users` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.465662 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.468183 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.551702 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1450/2879] 10.222.0.27 () {60 vars in 1143 bytes} [Tue Jul 12 07:34:43 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 07:34:43.555727 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.566043 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1d052-4492-41f8-8c81-b95590bbebdc admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.570561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.576502 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:43.585516 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1430/2880] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:43.589807 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.601676 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398f333-1f18-4838-b113-59fb86c1392c admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.606831 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.607764 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.608835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.608835 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] PATH_INFO: `/v3/projects/482acba571a9421b9c83bbd620058bbd/users/044749bf1ab74a66a53911db3f31ee15/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.623959 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] RBAC: Authorizing `identity:create_grant(project_id=482acba571a9421b9c83bbd620058bbd, user_id=044749bf1ab74a66a53911db3f31ee15, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.626652 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.740442 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1451/2881] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:34:43 2022] PUT /identity/v3/projects/482acba571a9421b9c83bbd620058bbd/users/044749bf1ab74a66a53911db3f31ee15/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:43.744558 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.755087 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce5197-1cb0-46a7-9765-cc95b5878018 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.814543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.815300 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.815585 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.815862 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.816591 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.818205 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e71c-2a71-4f14-8d47-2706e10cde32 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.827972 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1431/2882] 10.222.0.27 () {58 vars in 1121 bytes} [Tue Jul 12 07:34:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 07:34:43.832952 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:43.845291 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e705f93-6bbb-4300-a143-938d3b2bfbde admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:43.850933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:43.851859 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] REQUEST_METHOD: `PUT` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:43.852165 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:43.852413 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] PATH_INFO: `/v3/projects/482acba571a9421b9c83bbd620058bbd/users/044749bf1ab74a66a53911db3f31ee15/roles/ac75a1032bab4f8ba653ed71e6b0dfe9` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:43.854663 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=482acba571a9421b9c83bbd620058bbd, user_id=044749bf1ab74a66a53911db3f31ee15, role_id=ac75a1032bab4f8ba653ed71e6b0dfe9)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:43.857459 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:43.869119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1452/2883] 10.222.0.27 () {60 vars in 1482 bytes} [Tue Jul 12 07:34:43 2022] PUT /identity/v3/projects/482acba571a9421b9c83bbd620058bbd/users/044749bf1ab74a66a53911db3f31ee15/roles/ac75a1032bab4f8ba653ed71e6b0dfe9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:34:49.309388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c5ca-73ff-4185-be78-4af39165f34b None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:49.309902 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c5ca-73ff-4185-be78-4af39165f34b None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:49.310000 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c5ca-73ff-4185-be78-4af39165f34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:49.341947 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-1ae4c5ca-73ff-4185-be78-4af39165f34b None None] MFA Rules not processed for user `044749bf1ab74a66a53911db3f31ee15`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:49.343178 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-1ae4c5ca-73ff-4185-be78-4af39165f34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:49.419440 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1432/2884] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:49.432104 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:49.497986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6aaf92-be57-4e35-a193-9c62a7c7b37b admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:49.501671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fe3582d28dc473ebf4d7265c331c602', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:49.502492 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:49.502867 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:49.503289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:49.579774 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:49.581938 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:49.590972 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1453/2885] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:34:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:34:49.812136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc31209-e79d-452e-a088-ed924c9d87b5 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:49.812419 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc31209-e79d-452e-a088-ed924c9d87b5 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:49.812696 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc31209-e79d-452e-a088-ed924c9d87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:49.831430 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-dcc31209-e79d-452e-a088-ed924c9d87b5 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:34:49.832641 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-dcc31209-e79d-452e-a088-ed924c9d87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:49.894452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1433/2886] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:34:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:34:49.906618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:34:49.908060 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:34:49.952471 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:34:49.985095 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5640e17-5976-433a-86f3-72ab7f47e3cd service glance] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:34:49.990609 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:34:49.991379 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:34:49.991727 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:34:49.992067 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:34:50.000942 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:34:50.003186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:34:50.011574 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1454/2887] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:34:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:34:59.886880 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:00.008540 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=15 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:00.587672 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:00.588069 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:00.588379 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:00.606263 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] MFA Rules not processed for user `5f79798a1b8b48578b216f8df23bf286`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:35:00.607445 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:00.615169 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1434/2888] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:35:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:35:00.866179 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:00.867579 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:00.922624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd63fb1-4d8f-4d51-b993-9c7c10c557e8 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:00.926295 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:00.926933 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:00.927216 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:00.927484 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:00.929257 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:00.938501 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:00.941302 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8d77c-7720-401e-a315-672b2e3173af service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:00.948227 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1455/2889] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:35:02.668479 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:02.669886 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:02.758885 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f4cd5-4bb1-4d5e-bed3-542550a00501 None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:02.763814 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:02.764460 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:02.764741 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:02.765013 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:02.766761 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:02.778487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:02.780049 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:02.792442 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1435/2890] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:35:04.223007 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] REQUEST_METHOD: `POST` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:04.223489 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:04.223640 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:04.248214 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.auth.core [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80336) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:35:04.249488 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:04.259453 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1456/2891] 10.222.0.27 () {58 vars in 1009 bytes} [Tue Jul 12 07:35:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:35:04.275631 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:04.288058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7586636-5ccf-4f8f-8e5f-4f768535d8c8 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:04.293372 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:04.294946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:04.294946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:04.294946 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:04.303971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:04.305670 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1277298d-ac27-4db2-a58d-5255b7ab565f service swift] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:04.314354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1436/2892] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:35:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:35:05.327282 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:05.442999 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a288e52-ed24-44c9-a6b4-d0b4a288e272 None None] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:05.452083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:05.452083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:05.452083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:05.452083 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] PATH_INFO: `/v3/users/2516a6fa225f462e867e8b2ee9d0589a` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:05.453307 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2516a6fa225f462e867e8b2ee9d0589a)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:05.456837 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:05.711472 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2516a6fa225f462e867e8b2ee9d0589a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:05.796390 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2516a6fa225f462e867e8b2ee9d0589a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:05.835978 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2516a6fa225f462e867e8b2ee9d0589a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:05.836901 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2516a6fa225f462e867e8b2ee9d0589a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:05.853587 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2516a6fa225f462e867e8b2ee9d0589a'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:05.864872 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1457/2893] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:35:05 2022] DELETE /identity/v3/users/2516a6fa225f462e867e8b2ee9d0589a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:35:05.869432 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:05.869893 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:05.870128 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:05.894616 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] MFA Rules not processed for user `ea7c343155f0487dbe56b20027ac902d`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:35:05.896303 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:05.987487 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1437/2894] 10.222.0.27 () {58 vars in 957 bytes} [Tue Jul 12 07:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 07:35:05.997215 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:05.998722 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:06.019986 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:06.065695 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20762f-01fe-4061-894b-84189201bbe7 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:06.069680 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:06.070419 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:06.070668 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:06.070956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:06.082559 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:06.084025 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:06.096314 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1458/2895] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:35:06.621469 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:06.622510 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:06.649184 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466b079-5160-4c87-80f5-e6c0b127edeb None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:06.670719 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:06.672528 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:06.673097 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:06.673562 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] PATH_INFO: `/v3/projects/c6336c34a0f041db9e864244f710d3f3` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:06.676452 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6336c34a0f041db9e864244f710d3f3)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:06.681519 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:06.808583 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:06.811226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6336c34a0f041db9e864244f710d3f3', 'request_id': 'req-0af7d2c9-91fd-48e1-abab-3d3481c878a2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:06.888037 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6336c34a0f041db9e864244f710d3f3', 'request_id': 'req-0af7d2c9-91fd-48e1-abab-3d3481c878a2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:06.894978 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6336c34a0f041db9e864244f710d3f3', 'request_id': 'req-0af7d2c9-91fd-48e1-abab-3d3481c878a2'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:06.907209 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] The token cache is being invalidate because project c6336c34a0f041db9e864244f710d3f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80337) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:35:06.907494 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:06.908398 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:35:06.910226 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1438/2896] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:35:06 2022] DELETE /identity/v3/projects/c6336c34a0f041db9e864244f710d3f3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:35:16.127351 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=19 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:16.903975 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:25.918649 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:25.920050 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:25.931240 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e63f96-e47f-46e6-ba8b-ecf32b98efc6 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:25.981270 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:25.981926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:25.982231 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:25.982510 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:25.984289 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:26.045862 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:26.047346 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:26.056979 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1459/2897] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:35:36.052506 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=50 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:35:55.897130 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:55.898561 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:55.911054 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af7d2c9-91fd-48e1-abab-3d3481c878a2 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:55.915860 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:55.917277 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:55.917772 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:55.918050 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:55.920467 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:56.009340 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:56.010873 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:56.032700 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1439/2898] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:35:57.223456 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:35:57.224777 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:57.236169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f4e5e-d74d-4566-99d9-c2bced2a5574 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:35:57.239912 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:35:57.240556 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:35:57.240841 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:35:57.241158 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:35:57.242956 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:35:57.257426 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:35:57.259369 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:35:57.270710 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1460/2899] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:35:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:36:06.030021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=43 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:36:07.265475 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=6 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:36:46.197996 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:36:46.208837 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ed9d02-d5d4-4b48-a9bc-456be50fbc27 service neutron] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:36:46.223361 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '13212d1708cc4c00867ebf6d713559d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:36:46.224012 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:36:46.224304 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:36:46.224584 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:36:46.226944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:36:46.239026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:36:46.240485 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf9a3d8-7cd0-4dc0-b80e-f9240ba2cfc2 service neutron] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:36:46.250955 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1440/2900] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:36:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:36:52.851664 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:36:52.853130 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:36:52.868533 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477d9cb-17c1-4f69-ae49-d812ffbfc367 service neutron] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:36:52.874694 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd3f89d420e4418babdbac8736d8fa5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:36:52.875342 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:36:52.875628 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:36:52.875906 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:36:52.877671 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:36:52.898969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:36:52.898969 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:36:52.902122 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1461/2901] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:36:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:36:53.998407 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] REQUEST_METHOD: `POST` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:36:53.998845 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:36:53.998944 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:36:54.046354 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.auth.core [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] MFA Rules not processed for user `9fe24e20dfe24dc3904bd0b8831c1c7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80337) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 07:36:54.047541 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:36:54.110643 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1441/2902] 10.222.0.27 () {58 vars in 967 bytes} [Tue Jul 12 07:36:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 07:36:54.150420 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:36:54.151838 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:36:54.240625 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610be7c-e3b8-4b6b-95d7-5be00baf4d0e service nova] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:36:54.245614 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f43a49de2754455795ab92ede9138eb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:36:54.246371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:36:54.246653 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:36:54.246926 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:36:54.254803 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:36:54.256371 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:36:54.265186 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1462/2903] 10.222.0.27 () {60 vars in 1384 bytes} [Tue Jul 12 07:36:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 07:37:02.239775 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:02.242082 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:02.312271 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92aaba6-9332-4469-859d-843d7589b70f None None] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:02.316834 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:02.317774 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:02.318058 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:02.318333 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] PATH_INFO: `/v3/users/5f79798a1b8b48578b216f8df23bf286` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:02.319542 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f79798a1b8b48578b216f8df23bf286)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:02.321577 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:02.514270 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f79798a1b8b48578b216f8df23bf286'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:02.577320 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f79798a1b8b48578b216f8df23bf286'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:02.577930 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f79798a1b8b48578b216f8df23bf286'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:02.583287 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:02.590136 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f79798a1b8b48578b216f8df23bf286'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:02.597233 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f79798a1b8b48578b216f8df23bf286'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:02.603095 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1442/2904] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:37:02 2022] DELETE /identity/v3/users/5f79798a1b8b48578b216f8df23bf286 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:02.833666 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:02.842073 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0ed79-a71a-4053-9e33-264cb8c0f2a7 service swift] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:02.899315 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:02.900176 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:02.900452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:02.900721 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] PATH_INFO: `/v3/projects/49b71b80bc6d4e50b98c15eabab47a83` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:02.901948 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b71b80bc6d4e50b98c15eabab47a83)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:02.904356 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:03.004366 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b71b80bc6d4e50b98c15eabab47a83', 'request_id': 'req-8657de9b-f2c0-4128-928a-1f4da9db22e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.063100 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b71b80bc6d4e50b98c15eabab47a83', 'request_id': 'req-8657de9b-f2c0-4128-928a-1f4da9db22e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.065155 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:03.069601 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b71b80bc6d4e50b98c15eabab47a83', 'request_id': 'req-8657de9b-f2c0-4128-928a-1f4da9db22e2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.080464 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] The token cache is being invalidate because project 49b71b80bc6d4e50b98c15eabab47a83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:37:03.082966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.082966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.082966 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1463/2905] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:37:02 2022] DELETE /identity/v3/projects/49b71b80bc6d4e50b98c15eabab47a83 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:03.087112 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:03.088676 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:03.103022 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d28e5-e7ce-46fd-95a0-85ded4ed1766 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:03.161411 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:03.162284 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:03.162587 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:03.162836 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] PATH_INFO: `/v3/users/044749bf1ab74a66a53911db3f31ee15` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:03.164021 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=044749bf1ab74a66a53911db3f31ee15)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:03.166088 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:03.351497 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '044749bf1ab74a66a53911db3f31ee15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.411343 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '044749bf1ab74a66a53911db3f31ee15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.411949 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '044749bf1ab74a66a53911db3f31ee15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.424783 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '044749bf1ab74a66a53911db3f31ee15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.431821 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '044749bf1ab74a66a53911db3f31ee15'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.438416 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1443/2906] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:37:03 2022] DELETE /identity/v3/users/044749bf1ab74a66a53911db3f31ee15 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:03.676233 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:03.677732 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:03.692715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657de9b-f2c0-4128-928a-1f4da9db22e2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:03.750528 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:03.751398 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:03.751682 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:03.751955 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] PATH_INFO: `/v3/projects/482acba571a9421b9c83bbd620058bbd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:03.753209 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=482acba571a9421b9c83bbd620058bbd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:03.755119 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:03.860801 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '482acba571a9421b9c83bbd620058bbd', 'request_id': 'req-5b576438-f768-46e4-aebc-fbb19ab417d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.931783 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '482acba571a9421b9c83bbd620058bbd', 'request_id': 'req-5b576438-f768-46e4-aebc-fbb19ab417d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.939107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '482acba571a9421b9c83bbd620058bbd', 'request_id': 'req-5b576438-f768-46e4-aebc-fbb19ab417d2'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.949734 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] The token cache is being invalidate because project 482acba571a9421b9c83bbd620058bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:37:03.950020 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.955392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:03.955392 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1464/2907] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:37:03 2022] DELETE /identity/v3/projects/482acba571a9421b9c83bbd620058bbd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:13.434743 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:13.946458 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=55,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:49.911709 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:49.913161 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:49.989773 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96a064-9d7b-4645-b1c2-441a7af14331 admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:50.050747 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d4865-abb1-46dd-8188-225237961173 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:50.051381 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4865-abb1-46dd-8188-225237961173 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:50.051668 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4865-abb1-46dd-8188-225237961173 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:50.051970 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d4865-abb1-46dd-8188-225237961173 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:50.057098 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-590d4865-abb1-46dd-8188-225237961173 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:50.071288 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d4865-abb1-46dd-8188-225237961173 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:50.072988 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d4865-abb1-46dd-8188-225237961173 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:50.083480 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1444/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:37:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:37:53.323726 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:53.325169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:53.339739 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b576438-f768-46e4-aebc-fbb19ab417d2 admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:53.344922 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:53.348827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] REQUEST_METHOD: `GET` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:53.348827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:53.348827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:53.348827 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:53.359518 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:53.361624 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:53.371729 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1465/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:37:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:37:53.437316 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d4865-abb1-46dd-8188-225237961173 service placement] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:53.440630 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-590d4865-abb1-46dd-8188-225237961173 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:53.505324 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d4865-abb1-46dd-8188-225237961173 service placement] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:53.509768 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:53.510637 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:53.510926 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:53.511206 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] PATH_INFO: `/v3/users/cfa09bb48d4c4d8cb35b1a8bc5b6702f` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:53.512388 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfa09bb48d4c4d8cb35b1a8bc5b6702f)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:53.514334 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:53.693133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:53.701866 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfa09bb48d4c4d8cb35b1a8bc5b6702f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:53.779323 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfa09bb48d4c4d8cb35b1a8bc5b6702f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:53.779962 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfa09bb48d4c4d8cb35b1a8bc5b6702f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:53.792171 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfa09bb48d4c4d8cb35b1a8bc5b6702f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:53.799133 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfa09bb48d4c4d8cb35b1a8bc5b6702f'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:53.805032 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1445/2910] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:37:53 2022] DELETE /identity/v3/users/cfa09bb48d4c4d8cb35b1a8bc5b6702f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:54.047169 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:54.055154 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956aef3-2a91-4ae6-8b1b-1d3f28a97212 service placement] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:54.112345 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:54.113235 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:54.113517 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:54.113789 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] PATH_INFO: `/v3/projects/28ff3fec442a4de486b65b19bcc1d4eb` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:54.114975 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ff3fec442a4de486b65b19bcc1d4eb)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:54.116871 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:54.228608 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ff3fec442a4de486b65b19bcc1d4eb', 'request_id': 'req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.302700 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ff3fec442a4de486b65b19bcc1d4eb', 'request_id': 'req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.310618 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ff3fec442a4de486b65b19bcc1d4eb', 'request_id': 'req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.320958 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] The token cache is being invalidate because project 28ff3fec442a4de486b65b19bcc1d4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:37:54.321275 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.321911 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.323454 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1466/2911] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:37:54 2022] DELETE /identity/v3/projects/28ff3fec442a4de486b65b19bcc1d4eb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:54.327385 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:54.328868 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:54.342842 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f03af7-1622-4273-8c3f-02543fab56df admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:54.397993 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:54.398856 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:54.399137 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:54.399412 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] PATH_INFO: `/v3/users/2962989bb4444fcb8b262db59dca2775` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:54.400600 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2962989bb4444fcb8b262db59dca2775)` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:54.402527 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:54.570971 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2962989bb4444fcb8b262db59dca2775'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.647927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2962989bb4444fcb8b262db59dca2775'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.648543 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2962989bb4444fcb8b262db59dca2775'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.660760 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2962989bb4444fcb8b262db59dca2775'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.667656 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.notifications [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2962989bb4444fcb8b262db59dca2775'} {{(pid=80337) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:54.674026 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1446/2912] 10.222.0.27 () {58 vars in 1223 bytes} [Tue Jul 12 07:37:54 2022] DELETE /identity/v3/users/2962989bb4444fcb8b262db59dca2775 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:37:54.918107 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Authenticating user token {{(pid=80336) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:37:54.921715 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.fernet_utils [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80336) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:37:54.934452 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75de2a-c0cf-4b13-b65b-9274c73cb86f admin admin] Validating token access rules against request {{(pid=80336) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:37:54.994094 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea7c343155f0487dbe56b20027ac902d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '283d7870f6d24d52afa389aaf0d60d70', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80336) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:37:54.995008 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:37:54.995292 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:37:54.995570 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] PATH_INFO: `/v3/projects/ab8c697589664085b5d48d805b2d43dd` {{(pid=80336) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:37:54.996753 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8c697589664085b5d48d805b2d43dd)` {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:37:54.998697 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] RBAC: Authorization granted {{(pid=80336) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:37:55.021210 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:37:55.112144 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8c697589664085b5d48d805b2d43dd', 'request_id': 'req-11dba817-811a-44db-b05d-e4fe3f3046b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:55.225096 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8c697589664085b5d48d805b2d43dd', 'request_id': 'req-11dba817-811a-44db-b05d-e4fe3f3046b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:55.231660 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8c697589664085b5d48d805b2d43dd', 'request_id': 'req-11dba817-811a-44db-b05d-e4fe3f3046b4'} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:55.243202 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] The token cache is being invalidate because project ab8c697589664085b5d48d805b2d43dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80336) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 07:37:55.243485 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:55.244103 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG keystone.notifications [None req-11dba817-811a-44db-b05d-e4fe3f3046b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80336) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 07:37:55.245693 dv-cinder-825492-25-smb devstack@keystone.service[80336]: [pid: 80336|app: 0|req: 1467/2913] 10.222.0.27 () {58 vars in 1232 bytes} [Tue Jul 12 07:37:54 2022] DELETE /identity/v3/projects/ab8c697589664085b5d48d805b2d43dd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 07:38:04.670015 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=69,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:38:05.323041 dv-cinder-825492-25-smb devstack@keystone.service[80336]: DEBUG dbcounter [-] [80336] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80336) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 07:40:14.158601 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Authenticating user token {{(pid=80337) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 07:40:14.160008 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:40:14.229255 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7815e-803d-42e6-8081-203a6767228a admin admin] Validating token access rules against request {{(pid=80337) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 07:40:14.286512 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '231bf5521c35488f864e6bad34fdaf41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eeb4c2659aee4cf4ba0650e10f402ee4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80337) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 07:40:14.287158 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] REQUEST_METHOD: `GET` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 07:40:14.287444 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] SCRIPT_NAME: `/identity` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 07:40:14.287718 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80337) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 07:40:14.290042 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.fernet_utils [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80337) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 07:40:14.300843 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 07:40:14.302428 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4753aec-f9c5-4226-9deb-56219f5d97c9 service placement] RBAC: Authorization granted {{(pid=80337) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 07:40:14.313307 dv-cinder-825492-25-smb devstack@keystone.service[80337]: [pid: 80337|app: 0|req: 1447/2914] 10.222.0.27 () {60 vars in 1365 bytes} [Tue Jul 12 07:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 07:40:24.308927 dv-cinder-825492-25-smb devstack@keystone.service[80337]: DEBUG dbcounter [-] [80337] Writing DB stats keystone:SELECT=58 {{(pid=80337) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}